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FOREWORD 


THE PRESENT book, together with its companion volume devoted to 
the differential and integral calculus, contains the fundamental part 
of the material dealt with in the larger courses of mathematical 
analysis. Included in this volume are general problems of the theory 
of continuous functions of one and several variables (with the 
geometrical basis of this theory), the theory of limiting values for 
sequences of numbers and vectors, and also the theory of numerical 
series and series of functions and other analogous infinite processes, 
in particular, infinite continued fractions. 

Chapter I, “The arithmetical linear continuum and functions 
defined there" (authors: L. A. Lyusternik and Ye. К. Isakova), 
is devoted to real numbers, the arithmetical linear continuum, li- 
miting values, and to functions of one variable. The material of this 
chapter is more or less that which is usually called the introduction 
to mathematical analysis. 

Chapter П, “n-dimensional spaces and functions defined there” 
(L. A. Lyusternik), effects the transition from functions of one 
variable to functions of п variables, which, geometrically, corresponds 
to the transition from the arithmetical linear continuum to n-dimen- 
sional space E„ the fundamental theory of which is given. $115 devoted 
to the fundamentals of n-dimensional geometry and, in particular, 
of the theory of orthogonal systems of vectors in E,, which serves 
as a simpler model for the theory (Chapter IV) or orthogonal systems 
of functions. §2 is devoted to limiting values in E,, to continuous 
functions of л variables and their systems (transformations in E,). 
In this chapter also $3 deals with a subject which plays an important 
part in pure and applied mathematics, the theory of n-dimensional 
convex bodies. 

Chapter III, “Series” (authors С. S. Salekhov and У. L. Danilov), 
consists of the theory of series and practica! methods of summation. 

The theory of numerical series is dealt with in $1 including ques- 
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tions relating to infinite products, double series and the summation 
of convergent series. Side by side with the classical material the reader 
will find new results about the general tests for the convergence of 
series and estimations of the remainder. 

The more important classes of series of functions are considered 
in §2: power, trigonometrical, and also asymptotic power series, 
and their convergence. At this point some methods for the general 
summation of divergent series are added. In §3 are to be found various 
devices useful in calculations connected with the theory of series. 

Chapter IV “Orthogonal series and orthogonal systems” (authors 
А. М. Ivanova and L. A. Lyusternik), contains the general problems 
of the reduction of functions to orthogonal (and also biorthogonal) 
series. Here, also, general orthogonal systems of polynomials and 
the classical systems of Legendre, Chebyshev, Hermite Polynomials, 
and others, are considered. 

Chapter V “Continued fractions” (author A. N. Khovanskii), 
deals with that branch of analysis which occupied the attention 
of the greatest mathematicians of the eighteenth and nineteenth 
centuries, but which was afterwards unjustly forgotten. Continued 
fractions did not find a place in the contemporary larger courses of 
analysis; on the other hand comparatively recently, some elements 
of the theory of continued fractions were studied even in middle 
school. In the past few years the interest in continued fractions has 
revived in connection with their application in computation and 
other topics in applied mathematics. 

Chapter VI, “Some special constants and functions” (authors 
І. A. Lyusternik, І. Ya. Tslaf and A. В. Yanpol’skii), has more of 
the nature of a manual (in the narrow sense of the word). The mate- 
rial here concerns various constants, the most important systems 
of numbers, including Bernoulli and Euler numbers, some discon- 
tinuous functions, and the simpler special functions (elliptic integrals, 
integral functions, the gamma and beta functions, some Bessel 
functions, etc.). These functions, together with orthogonal polyno- 
mials, after the elementary ones, are the most widely used in appli- 
cations of mathematics, We would like to mention that these special 
functions will be dealt with more fully and in the complex domain 
in one of the following issues. 


СНАРТЕК 1 


THE ARITHMETICAL LINEAR 
CONTINUUM AND FUNCTIONS 
DEFINED THERE 


§ 1. Real numbers and their representation 
1. Real numbers 


All real numbers can be split into two classes: rational and irra- 
tional, All integers and fractions (positive, negative and zero) are 
rational numbers, while the remaining numbers are irrational. 

The set of all rational numbers is everywhere dense, i.e. between 
any two distinct rational numbers а and b (а<Ь) there is at least 
one further rational number c (а<с< Б), i.e. in fact, an infinity of 
rational numbers. 

Examples of irrational numbers are: /2 = 1-41421356..., л = 
=3:14159...,е = 2:7182818 . . .— the base of natural logarithms, and so 
on. Irrational numbers consist of algebraic and transcendental numbers. 
Algebraic irrational numbers are defined as all non-integral real 
roots of the algebraic equation 


X^ aux uus ag ax tay - 0, 


where а, (і = 1, 2,..., п) are integers; for example, the roots 
х = 4/10, x = of the equations 23—10 = 0, x5—8 = 0, the 
roots of the equation х5 — 3x4 — 223 + x? +- | = 0, and so on. The remain- 
ing irrational numbers are described as transcendental; examples 
of these are л, e, e^, 212, log n (where n is any integer not equal to 
10*) and so on. 
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2. The numerical straight line 


We choose on a straight line E, an origin of measurement — the 
origin of coordinates 0, a scale the unit of length, and a direction — 
the orientation. We associate with every real number x a point A(x) 
on the line E,, having the coordinate (abscissa). x, conversely, with 
every point A(x) on £,, we associate а real number x — its abscissa. 
Е, is called a numerical straight line ог a one-dimensional coordinate 
Space (see Chapter П for n-dimensional coordinate spaces E,). 

The number 

—а for а<0, 
№1 = | a for а=0 


is called the absolute or numerical value of the number a. 
The following relationships hold: 
ja+b| = [а|+| 6} 
ja—b| = ||@|-|6 ||, 


la. 5| = [а|-[5}, 
1-8 


The number [a— b] is called the distance between the points a and 
b on the straight line E, (see Chapter II, § 1, sec. 1). 


3. p-adic systems 


Every real number is expressible as a decimal fraction, і.е. has a 
definite expansion in the decimal system of numeration. The decimal 
system is a particular case of a positional system to the base p, where 
any positive integer p > 1 can betaken as the base. The numbers 
0,1, 2,..., р—1 are called the digits of this system, while p* 
(К = 0, +1, +2, ...) are units of the kth order in the system. 

Every positive integer М is uniquely expressible in the form 


n 
N = agp? a, pi... asp" = У ар, (1.1) 
tad 
where а; are digits. Equation (1.1) is written as 


N = аа, a0, 5... 1g. (1.17) 
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Similarly, any positive real number S, rational or irrational, is 
expressible as a fraction to the base p: 


n 


S= Y ap (1.2) 


Во 


which is written as 
S = ay a + + + d1dg, R40 50 3... - (1.2) 


If S is an irrational number, it is uniquely expressible by an infinite 
non-periodic fraction to the base p of the form (1.2) (or (1.2’)). 

If S is rational, it is expressible as an infinite periodic fraction to 
the base p, e.g. the number 5 = 1/6 is written in the decimal system 
as 

S = 01666... = 0:1 (6). 
In the binary system, 5 = 1/6 is expressed by the infinite fraction 
1 1 


Rational numbers to the base p are numbers expressible as fractions 
with denominator p? (k = 1, 2, —2:...); each such number has two 
forms in the system to the base p: one with 0 repeated, the otber 
with p—1 repeated. 


1 : В 3 
For example, the number S — з is written in the binary system as 


S = 01000... = 0:1 (0), 
S = 00111... = 0-0); 
and in the decimal system as 
S 205000... = 0:5 (0), 
S = 04999... = 0-4 (9). 
Having selected one of these forms for rational numbers to the 
base p, say the first — with 0 repeated, we obtain a unique form for 


rational numbers to the base p as infinite periodic fractions to the 
base p, and at the same time a unique form for every real number. 


The elements of various p-based systems were to be found in antiquity in diffe- 
rent nations, and traces have been preserved into modern times in certain 
languages, e.g. of p — 12 (dozens and grosses), p — 20 (traces of this system have 


4 MATHEMATICAL ANALYSIS 


been preserved in French), p = 40 (“forty times forty” refers to number of chur- 
ches in Moscow (Trans.)), etc. The system to the base 60 was well developed; it 
originated in ancient Babylon (traces are retained in measurement of angles and 
time). The 60-base system must have competed with the decimal in the Middle 
Ages in the Near East and Central Asia. The decimal system originated in 
India, was further developed in Central Asia, and passed from there into 
Europe. 


At the present time the binary system is widely used in computers 
(together with the related systems having powers of two as base: 
р = 2k, k > 1 an integer). A system of numeration to the base three 
is used іп the Moscow State University **Setun" computer. A set of 
numbers different from 0, 1, 2, ..., p—1 is occasionally used for 
the p digits of the system to the base p. For instance, a convenient 
Choice of digits in the system to the base 3 is —1, 0, 1. The digits 
—1 and 1 can be used in the binary system. 


Non-homogeneous positional systems are more general; here, the ratios of 
units of different orders are different numbers. Such systems were used (before 
the introduction of the metric system) for representing “denominate” numbers, 
Le.forrepresenting magnitudes such as length, weight, etc. For example, the 
following system of units was used for measuring weight in pre-revolutionary 
Russia: 1 pud (16 kg) = 40 funtov, 1 funt (22400 g ) = 32 lota, etc. 


4. Sets of real numbers 


We shall discuss various sets of real numbers — for example, the 
set of natural numbers: 1, 2, 3, 4,..., n, ..., the set of all proper 
fractions, the set of all rational numbers, the set of all real numbers 
between 0 and 1, etc. 

The numbers are called the elements of the set in question. 


One can consider sets of elements of any kind, and not merely sets of real 
numbers. For instance. the set of points of a plane, the set of trees in a district, 
etc. The elements of these sets are respectively points of a plane, trees, etc. 


Sets are denoted in this book by capital letters: M, N, A, B, X, 
Y, etc., or by thesymbol ix) where x, are the elements of the set 
(countable sets). The set of numbers satisfying the inequalities 
a<x<b (a, b are numbers) is called an interval and is written as (a, Б). 
The sets of numbers satisfying the inequalities x- a, x>b, are called 
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infinite intervals and are written as (— œ, a) and (b, + œ) 

respectively. The set of numbers x satisfying the inequalities a = x =b 

is called a segment (or closed interval), and is written as [a, 5]. 
The sets of points x satisfying the inequalities 


azx-«b, a«xzb, 


are called semi-intervals and are written respectively as [a, 5), (a, Б]. 

The infinite semi-intervals (— œ, a] and [b, + œ} are similarly 
defined. 

The interval (x—e, x+ е), (= > 0) is called an e-neighbourhood of 
the point x. 

If an element x belongs (does not belong) to the set X, this is written 
symbolically as x € X (x € X or x 4 X). 

If all the elements of a set X are simultaneously elements of a set 
Y, X is said to be a subset of the set Y, and we write symbolically: 
X с Y. Otherwise, X is not a subset of Y, and we write this symbol- 
ically as X = Y (or X ¢ Y). For example, 


BHO 1, ає[а, 5, аЁ(а b, bgla, b); 


(0, 1) c [0, 1), [1, 2] = (0, 1), (а, 5) c [а, 5). 


The set М of all the elements that belong both to a set A and a 
set B is called the intersection or product of the sets A and B, and is 
written symbolically as 


М= АПВ (M= AXB = А.В = АВ). 
For example, 


(0, ЫБ по, 2), b=, BIN, с) 


and so оп. 

The set M consisting of all the elements that belong either to a set 
A or to a set Bis called the union or sum of sets A and В, and is denoted 
symbolically by 

M = AUB (M = A+B). 
For example, 


0, ET +=)=® +=), (-3 106 I= C5 8. 
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The set M consisting of the elements of a set B that do not belong 
to a set A is called the complement of the set 4 with respect to the set 
B or the difference between the sets 4 and B, and is written symboli- 
cally as 

М = ВХА (M = В- 4). 
For example, 


(7, 8] = (5, SIN(-3, т (0, BN E 2) = [z 2) etc. 


The notation BNA is employed in more general cases. 


5. Bounded sets, upper and lower bounds 


А set X of real numbers is said to be bounded from above (below) 
if there exists a number M (m), not less (not greater) than all the 
numbers x € Х. The number М (m) is called an upper (lower) bound 
of the set X. 

А set X is said to be bounded if it is bounded from above and below. 
For example, the set (— o», 0) is bounded from above, the set 
(0, + =) bounded from below, while (0, 1) is a bounded set. 

The least (greatest) of all the upper (lower) bounds of a set X is 
called the strict upper (lower) bound M* (т*) of the set X and is 
written symbolically as 

М* = supx (m* = inf x). 
xex xex 
The numbers M* and m* possess the following properties: 
(1) The inequalities hold for all x € X: 


M*gx m*zx. 


(2) Whatever the number = > 0, a number хо € X can be found 

for which, respectively, 
Xo = M*—e, хо m*+e. 
For example, 
sup x=0, inf x=0. 
хЄ(—°°, 0) xE (0, x) 

(3) If the set Х = {x} is bounded from above (below), it has a 

strict upper (lower) bound. 
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The concepts introduced below ($ 2, sec. 2) of strict upper and 
lower bounds of a function are particular cases of the strict upper 
and lower bounds of a set. 


6. The theory of irrational numbers 


Precise irrational number theories, due to Dedekind, Cantor and 
Weierstrass, made their appearance in the second half of the nineteenth 
century, in connection with the critical consideration of the funda- 
mental concepts of analysis. 

Dedekind's theory. 

The set of all rational numbers with all their properties is assumed 
given. The set of all rational numbers is divided into two classes A 
and А’. This division is called a section in the rational number domain 
if the following conditions are satisfied: 


(2) every rational number falls into one and only one of the sets 
A and A'. 

(b) every number a of the set А is less than every number а’ 
of the set £’. 


The set 4' is called the upper class, and the set А lower; a section 
is denoted by A4|A'. 

Sections can be of three types: 

(1) either there is no greatest number in the lower class A, while 
there is a least number г in the upper class A’; ` 

(2) or there is a greatest number r in the lower class А, while 
there is no least in the upper class 4’; 

(3) or there is no greatest in the lower class, and no least in the 
upper class. 

We say in the first two cases that the section is performed by the 
rational number г (which is the boundary between the classes А and 
А’), or that the section defines the rational number г. In the third case 
the section A|A’ defines no rational number; we say that a section of 
type (3) defines some irrational number «. 

For example, if all the numbers a = 0 are referred to class А, 
as also the numbers а > 0 for which а? = 2, while all the remainder 


are in class А’, the section A| A’ defines the irrational number 42. 
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All real numbers can be ordered in the following way: two irrational 
numbers « and f, defined by the sections 4|.4’ and B |B" respect- 
ively, are reckoned equal if the sections 4 | £’ and B | В’ are iden- 
tical, and conversely, if the sections А | A’ and B | В’ coincide, the 
respective irrational numbers are said to be equal. We say that 
the number a > ВИ the class А wholly contains the class B, which 
does not coincide with А, and « > r, where r is any rational number 
oftheclass А. Hence only one of the following relationships is possible 
for any two real numbers х and f :« = f,« = В, «>В. 

If sections are performed as described above in the domain of real 
numbers, it turns out that there always exists for any such section 
A | A' a real number accomplishing the section. This is the essence 
of Dedekind's basic theorem. This property of the set of all real 
numbers is described by saying that it is complete or continuous. 

We can introduce for real numbers the concepts of the arithmetical 
operations and laws (addition, multiplication, division by a non-zero 
number, etc.). For instance, the sum of two real numbers « and В 
is taken to be the real number у = а + f which satisfies the relationship 
a+b = y = а'+Ь', where а, a’, b and b’ are all possible rational 
numbers satisfying the inequalities: a = æ -< a', b < f <= b'. 

АП the other arithmetical operations can be similarly introduced, 
while retaining the fundamental properties. 

Cantor's theory. We take all possible fundamental sequences (see 
8 3, sec. 2) of rational numbers. А sequence of rational numbers, 
convergent to a rational limit, is fundamental. At the same time, there 
exist fundamental sequences of rational numbers which do not have 
rational limits, as for instance the sequence of decimal approximations 
{1; 04; 15413... } of the square root of two. 

Two infinite sequences (x,) and {y,} are said to be equivalent 
or confinal if | x, — y,| tends to zero as n + eo. This means that two 
equivalent fundamental sequences {x,} and {y,} can only have 
the same rational limit x as п ~ <, АП equivalent fundamental 
sequences of rational numbers are referred to one class — the equi- 
valence class, and the set of all fundamental sequences of rational 
numbers is divided into equivalence classes. 

There are two possibilities: either there exists a rational number 
ғ, the common limit as n + œ of all sequences {x,} of the same 
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equivalence class X, or there is no such number among all the rational 
numbers. 

We say in the first case that the equivalence class X defines the rati- 
onal number r; in the second case, we say that the equivalence class 
X defines an irrational number x (which is also regarded as the limit 
of the sequences of the class X as n — oo), Every equivalence class 
defines a real (rational or irrational) number. 

Arithmetical operations may also be introduced for all геа] numbers. 
For example, the sum x+y of two real numbers x and y is taken 
to be the number which is defined by the class X -- Y, where X is the 
equivalence class defining the number x, and Y the equivalence class 
defining the number у, the sum Х+ Y being understood as the class 
to which sequences of the form {x,+y,} belong, where (x,) is any 
sequence of X, and {y,} any sequence of Y. 

All the other arithmetical operations on real numbers may be simil- 
arly introduced. 

A real number x is said to be positive (x —0), if the corresponding 
equivalence class X contains a fundamental sequence of positive 
rational numbers not convergent to zero. 

The inequality х > В, where x and 8 are two real numbers, means 
that x —f > 0. 

The concepts of fundamental sequence and equivalence class can 
also be defined on the set E, of all real numbers. It turns out that 
all fundamental sequences are convergent on E, (see $ 3, sec. 2), 
so that any equivalence class on Е, defines a real number — the 
common limit of sequences convergent to it. No new numbers can 
be obtained with such a completion of the set Е,; in this sense, the 
set E, is complete. 

Thus the real number set Е, is obtained as a result of completion 
of the set of rational numbers by the limits of all possible fundamental 
sequences-of rational numbers. This idea of completion has acquired 
great value in functional analysis. 

As regards other irrational number theories, we may mention, 
in addition to Weierstrass’s, A.N. Kolmogorov’s argument (see 
ref. 6, p. 269) and the axiomatic construction of the real numbers 
(see ref. 4, p. 157, and ref. 15, p. 180). 
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§ 2. Functions. Sequences 


1, Functions of one variable 


If we are given a set of real numbers Х = {x}, and each number 
x € X is associated with a corresponding number y, where Y = {y} 
is the set of all such y, the function y = f(x) is said to be defined 
on the set X. The set X is called the domain of definition of the function 
Јох), and every number x є X the argument. The set Y is called the 
range of the function f(x). If the argument x is given, the value y — f(x) 
of the function is given. For instance, for the function y — x? the sets 
X and Y coincide with the real axis Ej; for the function y = tan x 
the set Y is the whole of the real axis Ej, while X = Е, — M, where 


M is the set of all numbers of the form a+ n(n = 0, +1, +2,...); 


for the function у= x! the sets Y and X are the sets of natural numbers; 
for the function y == E(x) (the integral part of x), X is the real line 
E,, and Y is the set of natural numbers. For the function 


.—1 for х<0, 
sign x — 0 for х=0, 
1 № x>0 


the set X is the real line, while the set У consists of three numbers: 
—1, 0, 1. 

Any finite set of numbers {a,} (i = 1, 2, ..., п) can be regarded 
as a function, given on the finite set of natural numbers X < (1, 2, 
‚..› п) and associating with each of these numbers i the value of the 
function Sf) = a, @ = 1, 2, ..., п). 

The concept of a function has been subjected to wide generaliza- 
tion. Y can be a set of arbitrary elements. A numerical function is 
said to be given on this set if a number f(x) is associated with every 
element x of the set. 

We shall consider in Chapter II functions defined on a set of 
points (or vectors) of n-dimensional space. The area bounded by a 
polygon, or its perimeter, can be regarded as functions defined on 
a set of plane polygons; physical magnitudes, such as the mass of 
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a body, its charge, etc. are defined on the set of corresponding physical 


bodies, etc. 
The elements of a set Х, on which a function is defined, are occa- 


sionally called points. 


2. Upper and lower bounds of a function 


An upper (lower) bound of a function f(x), defined on a set X, is 
a number M(m) such that f(x) = М(Кх) = т) for all x € X. If this 
number exists, the function f(x) is said to be bounded from above 
(below) on X. A function, bounded from above and below on X, 


is said to be bounded on X. 

The least (greatest) of all the upper (lower) bounds of a function 
Дх) is called the strict upper (lower) bound М*. (m*) of the function 
and is written as 

М* = sup f(x) [n = inf fe). 
we x ХЕХ 
If there exists ап element хо (x,) of X, for which 
хо) = sup Дх) ( Дх) = inf fo), 
ХЕХ ХЕХ 
Шеп 
sup f(x) = (xo) ( inf f(x) = fey) 
ХЕХ xex 


is called the absolute maximum (minimum) of the function f(x) and 
is written as 


Ах) = sup f(x) = max f(x) (fev = inf f(x) = min ду 
ХЕХ ХЕХ ХЕХ ХЕХ 
In this case, we say that f(x) attains its absolute maximum (minimum) 


at the point ху (xi) 
Given the finite set a,, а... , а, we write 


max {a), 22, ..., Gp} (min (ау, а, ..., 2) 
"n n 


for the maximum (minimum) of the numbers а, а, ...,а,. 
For example, 


: 1 "E Е 
inf —=0, minsinx = —1, max sinx= 1, 
х6 (0, =) X ЕЕ! x€ Ey 


max {4, 3, 7, 11, 8} = 11, min (4, 3, 2, 10, 17}= 2. 
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The following inequalities hold: 
(1) sup Хх) + sup f(x) = sup CHAC, (1.3) 
ХЕХ ХЕХ ХЕХ 
inf f(x)-- inf ЛО) = inf (Д) AGO). (14) 
хєх хєх хЕХ 


If f(x), A(x) and fi(x) + f(x) attain a maximum (minimum) on X, 
then we have 


Шах f(x) + лих ДОУ) = тах (Л) +Л0)), (1.3а) 
min f(x)+ min (х) = min (f(x) 440). (1.4а) 
ХЕХ ХЕХ хєх 


The sign of equality holds in (1.3a) (or in (1.4а)) when f(x) and 
(<>) attain a maximum (minimum) at the same point. 
For example, 


max sin x+ max cos x = 2 > max (sin x+cos х) = 42. 
xe Ey x€ Ey x€Ei 


(2) If Y c X (the set Y is part of the set X), we have 
| sup Дх) = sup f(x), inf fO) = inf fO. 
vex ХЕХ yey хєх 
Бог ехатріе, 
тах sinx = 42. max sin x = 1, 
хє [o i] жє ЕЁ 


max (3, 11, 15, 8) = 15 = шах (3, 11, 8) = 11. 
The following notation is often used, 
(00 = а), (Кх<а), (№0) = а), (Л) > а), (Л) = а) 


and similar ones, to denote the sets of points x for which the respective 
inequalities are satisfied (they are called Lebesgue sets). 


For instance, (x? < 2) is the interval (—./2, 4/2); (sin x = 1) is 
the set of numbers {+ бул} ‚ Where п is any integer. 
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3. Even and odd functions 


Let us consider functions defined on the real axis or on the segments 
[—а, a] and intervals ( — a, a) (in general on a set M, symmetric with 
respect to the origin). 

A function f(x) is said to be even if f( — х) = f(x) for any x of 
its domain of definition, and odd if f( — x) = — f(x). All even powers 
х?" are even functions, and all odd х2^+1 are odd functions. Other 
examples of even functions are cos x, | x|, and of odd: sin x, tan x, 
etc. 

A sum of even functions is even, and of odd, odd. The product of 
even functions is even; the product of an even number of odd functions 
is even, and of an odd number, odd. For example, sin x tan x is 
an even function, x sin x tan x is odd. The product (and quotient) 
of an odd and even function is odd. For example, |x| sin x is odd. 

А constant is an even function. 

Any function of an even function is an even function, e.g. e!*!, 
sin (cos x) are even functions. An even function of an odd function 
is an even function, e.g. cos (sin x). An odd function of an odd func- 
tion, is an odd function, e.g. tan (sin x). 

Any function f(x) is expressible as the sum of an even function 
АС) and an odd function f(x): 


f(x) = лол, 


where 


AG) = LU f 390 C. 


AG) = 3 Ut9- f -3)- C 


(C is a constant). 


4. Inverse functions 


Given two sets X and Y, each element x € X being associated with 
some element y = A(x) € Y, a mapping (or correspondence) A of 
the set X into the set Y is said to be given. 
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If = A(x), y € Y is called the image of the element хє X, while 
x is the pre-image of y. 

If a unique element x € X corresponds as pre-image to each element 
y € Y, the mapping (correspondence) A is called a one-to-one mapping 
of X into Y. 

EXAMPLE 1. Let all the houses of a street be numbered by the 
integers from 1 to 80. We have a one-to-one correspondence 
between tbe set of houses and the set of the first 80 natural numbers. 

EXAMPLE 2. Let E' be the set of all non-zero real numbers; one of 
the two signs -- or — is associated with each number x € E'. We 
have a mapping of Е” into the set of signs consisting of two elements; 
the pre-images of the sign + (—) are all positive (negative) numbers. 

Let the sets X and Y be sets of the numerical axis Е; the mapping 
А = f(x) of the set X into У is some function y = Дх), defined on 
the set X, with the domain of values Y. 

If the function y = f(x) is a one-to-one mapping of the set X into 
the set Y, we say that there exists for the function f(x) the inverse 
function x = p(y), which maps the set Y into the set X. The set Y is 
the domain of definition of the function x = ф(у), while the set X 
is its range. 

1 


EXAMPLE 3. у = sin x, x = arc sin y, X = E т^]. 


EXAMPLE & y= tan x x= arctan yy X = |1 i] 


EXAMPLE 5. y = e (К #0), x = (1k)log y, X = E. 


5, Periodic functions 


A function f(x) is called periodic if a number m>0 exists such 
that, for any x, 
Дачи) = fo). (1.5) 
The number o is called a period of the function f(x). If оу and 
€, are periods of f(x), о; + о, is also a period of f(x). 
The least of all such positive numbers w is called the least period 
(or simply the period) of the function Хх). 
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THEOREM 1. If a continuous (see $ 3, sec. 11) function f(x) is periodic 
and differs from a constant, then it has a least period о» > 0, and all 
its remaining periods are multiples of wo. 

For instance, when f(x) = sin x we have wọ = 2л, when f(x) = 
= {sin x| the period c, = л, and when f(x) = E(x) (see $ 2, sec 1) 
the period c = 1. 


6. Functional equations 


A functional equation is an equation connecting different values 
of functions; we say that a function, for which such an equation 
holds, is a solution of the functional equation, or, that the functional 
equation is satisfied by it. 

EXAMPLE 6. Solutions of the functional equation 

fé y) = fer fo) (1.6) 
include the linear functions 
Их) = Ех (Е is a constant). 


It can be shown that they are the only continuous functions satisfy- 
ing this functional equation. 
EXAMPLE 7. Solutions of the functional equation 


fo) Ло) = Дх+у) (1.7) 


include the exponential functions а“ (а = 0), these being the only 
continuous functions that satisfy this equation. 
Notice that periodic functions satisfy the functional equation 


fero) = fi). 
We can also discuss systems of functional equations. For instance, 
the pair of functions 
Дх) = sinx, p(y) = cosy 
(and the pair of functions f(x) = 0, ф(х) = 0) is the unique con- 
tinuous solution of the system of functional equations 
JG y) = fO), 
qx у) = ф(х)Ф(у) — Дх)Ду), 
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if we required in addition that the functions be positive in the interval 
(б 37) and that the conditions f (34) = 1,ф (т^) = 0 be 
satisfied. 


7. Numerical sequences 


A function, defined on the set of positive integers, is called an infinite 
numerical sequence if for each positive integer n(n =1, 2, 3,...) 
there is a corresponding number x, — the n-th term of the sequence 
{xq} = {х„ җ,...‚,х,...}. The number nin the expression x, 
is called the index (or subscript). We sometimes consider sequences 
{xn} where, in addition to the natural values, л can be zero or have 
any integral value. . 

We shall say that, when m >n, the term x,, follows the term x, 
(x, precedes x,,), independently of the actual magnitude of the numbers 
x, and хи. A sequence is regarded as given if a relation is known 
for forming the terms of the sequence. It is often possible to find 
an expression (formula) for the general term x,, of a sequence. 

EXAMPLE 8. Arithmetical progression 


X, = at(n— Па. 
EXAMPLE 9. Geometrical progression 
Xn = ag}, 
EXAMPLE 10. Decimal approximations to the numberz= 3:14159...: 
X= 3; x,—31; ж= 3-14; x, = 3:141; .... 
EXAMPLE 11. Let n— аа, ...a, be a given number in the decimal 
system, where 4j, @,...,а„ are digits; then the numbers x, = 


=0.аа„...аһап@ y,  0-a,a, ,...a, form numerical sequences 
when n = 1, 2, .... For example, when 


п = 15 we have x15 = 0-15; у; = 0:51. 
ExAMPLE 12. We decompose the positive integer л into prime 
factors 


n= ра. рае... pee, pilesgitl ||| pei 
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and define a sequence {x,} as follows: 
Xj ph . pe ede pie „ры — pun 


with n = 1, 2, 3, .... 

For example, n = 18 = 21.32, xy, = 3.27: = 3/2. 

It is possible to discuss sequences of vectors, functions, etc., as well 
as numerical sequences. 


8. Upper and lower bounds of a sequence 


А sequence X = {x,} is said to be bounded from above by a number 
M if x,z M for all indices п. In accordance with the definition 
given in $ 1, sec. 5, the number M is called an upper bound of the 
sequence {х„}. The sequence X = {x,} is said to be bounded from 
below by the number m, if x, = m for all n. The number т is called 
a lower bound of the sequence (x,). The sequence is said to be bounded 
if it is bounded from above and below. 

The least M*(greatest m*) of all the upper bounds M (lower bounds 
m) is called the strict upper (lower) bound of thesequence (x,) and 
is denoted, as before, by 


Sup x, = М* and ШЁх, = m*. 
n n 


The propositions of § 2, sec. 2, hold for the strict upper and lower 
bounds of a sequence {х„}. 


9. Maximum term of a sequence 


Given a sequence (u,) (k = 0, 1, 2, . . .), we sometimes want to find max u, — 
k 


the maximum term of the sequence {4}, provided such a term exists; let us callit и: 


У 


и = MAX up 
k 


The subscript of the maximum term of {u,} is called the central subscript and 
is denoted by ». If the terms of {чь} include several that are equal to д, the greatest 
of the subscripts of these terms is taken as v. 

If u, = u,(x) are functions of x, x € X c E, then» = у(х), и = p(x) are also func- 
tions of x. 

ExaMPLE 13. Given the sequence {u,(x) = x*/k1) (k = 0,1,2, . . ), the number 
v(x) = E(x) = n, while the maximum term (х)  x"/n! for non-integral x; if x is 
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an integer, x = т, then »(x) = m, while u(x) = и, = и. For example, with 
x = 6 we have (6) = 6, (6) = u, = 65/5! = 68/6! 

EXAMPLE 14. Given the sequence {u,(x)=2*/(2k+1)!} (k = 0 1, 2, ...), the 
index of the maximum term is defined by the inequality 


21(2п+1) =х = (21+2) (2n+3), 


and, with fixed x > 0, the maximum term и, corresponds to the value n = E(x). 


10. Monotonic sequences 


A sequence {xp} = (xy Xp... хи} is said to be monotonically 
increasing (decreasing), if 


х=ж№=ж<...< хр... 
(1.8) 
(х; > Хр > X3 >... > Xp > ...), 
and to be non-decreasing(non-increasing), if 
х= х,жхХх=... SHE... 
i (1.9) 
мМЕМЕ... Е =.... 


Sequences of the form (1.8) and (1.9) are described as monotonic, 
sequences of the form (1.8) being monotonic in the strict sense (or 
strictly monotonic). For example, the sequences {х„}, where 


1 1 
1 > Хи = 5 зи, Xn = 2+5(л—1) 


Xn = 2— ———- 
21184 — 

+3 
are monotonically increasing in the strict sense; the sequences {x,,}, 


where 
1 1 


X, = — Xn = 
m a 5, n үлї+1 3 
are monotonically decreasing in the strict sense; the sequence {x,}, 
where 


1 1 
x= 1; ж=5, =5, х= т» aly e 


is non-increasing; the sequence {х„}, where 
х=0,; x21, x,22, xm =2, x3=3, ж=4,... 


is non-decreasing. 
All the above-mentioned sequences are monotonic. 
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11. Double sequences 


A double sequence {a,m} is a function of a pair of integral subscripts 
nand т; to each pair of integers п and т there corresponds a number 
ам, — the term of the sequence {аи}. 

EXAMPLE 15. {ат = 1/(n?+m*)}(n, m = 1, 2, ...). 

If the numbers п and т are represented in the decimal system by 


п = акау... ау, } (1.10) 


т = baby "m b, 


(it can be assumed that n and т are represented by the same number 
of digits; this can always be arranged by putting a suitable number 
of zeros in front), we can form a double sequence (N,,,), where 


N= Nam = аһбак_\Рь-\ n a,b. (1.11) 


ExaMPLE 16. If п = 103, т = 27 = 027, then №, 97 = 100 237. 

Conversely, we can associate with every integer N, represented 
by the right-hand side of (1.11) (ifthe number of digits (2k —1) in N 
is odd we put the digit а„„= 0 in front), a corresponding pair of 
integers n and m in accordance with (1.10). 

We thus obtain a one-to-one correspondence between the set of 
pairs of integers and the set of all non-negative integers. 

EXAMPLE 17. Given the double sequence {ат} (n, m = 0, 1,2,...), 
it can be related thus to an ordinary sequence {by} (№ = 0,1,2,... 
when № = №, we have by = anm 

The double sequence {аш} is said to be arranged as the ordinary 
sequence {by}. 

See Chapter ПІ for the summation of double sequences (double 
series). 


§ 3. Passage to the limit 


1. The limit point of a set 


We call xy a limit point of a set X if there is at least one more 
point of X (different from хо) in any e-neighbourhood of the point 
Хо (= is any positive number). Alternatively, x, is a limit point of a set 
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X if an infinity of points of X is contained in any e-neighbourhood 
of xy. А set may have no (or even infinitely many) limit points, 
which may or may not belong to the set. For instance, the set Х = 
= (1/n), where n = 1, has one limit point 0, which does not belongto 
the set; every point of any interval (a, Б) (as also the points a and b) 
is a limit point of the interval. 

THEOREM 2 (Bolzano-Weiestrass). Every bounded infinite set X 
of E, has at least one limit point. 

A set M is said to be closed if it contains all its limit points. 
>, L, Vx L, S is a closed set; 
any segment [а, b] is a closed set. 

А set M in Е, is described as open or as a domain if any point 
appears.in M along with its e-neighbourhood. 

For example, any interval (x, В) is an open set; any system of 
intervals is an open set. 

The real axis is an open and a closed set; on the other hand, any 
semi-interval (x, Bj, [æ, В) is neither an open пог a closed set. 

The complement of an open (closed) set M with respect to E, is a 
closed (open) set. 

For instance, the complement of the open set (~ œ, 0) U (1, 
+ ә) is the closed set [0, 1]. 


For example, М = { 0, 


2. The limit point and limit of a sequence 


The number x is called a limit point of the sequence X = {x,} 
if any e-neighbourhood of x contains at least one term x,, of X 
different from x (i.e. an infinity of terms of the sequence). 

А bounded infinite sequence X = [x,) has at least one limit point. 

The constant number x, is called a limit of the sequence {x,} if, 
given any number = > 0, however small, there is a subscript М (depend- 
ing only on the choice of ғ) such that, for all n > №: 


[х„— Xo] < =. 


We say in thiscasethat {х„} has a finite limit х and write lim x, = хо, 
"n соо 
or that (x,) is convergent to хо, and write x, - хо. The sequence {x,} 


is said to be convergent in this case. This means geometrically that, 
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given any = > 0, from some subscript №, onwards, all the points x, 
lie in the neighbourhood (x — ё, хо+ =). In particular, x, is described 


as an infinitesimal if lim x, = 0. A sequence that has no limit is 
"n— oo 
said to be divergent. 


А sequence (x,), having the property that, given any є < 0, there 
exists a subscript N such that | x,, —x,| < e for all m — М, n = М, is 
described as fundamental. 

A general criterion for the convergence of a sequence {x,} is: 

THE BOLZANO-CAUCHY CRITERION. A necessary and sufficient 
condition for the sequence {x,} to be convergent is that it be funda- 
mental. 

We say that the limit of the sequence {x,} is equal to infinity, 

lim ид = ee, 

n> = 
if, no matter how large the number К > 0, there exists N such that, 
for all n> М, 


[Xp] > K. 
If the numbers x,(n > №) are positive (negative), we write 
„ш. хек аз (Gass uem E : 
Some limits: 
. lm M ERE Rod а (b з 0). 


а 
п Бик + Буп... +b, b 


сЕ: 
3 lim t/a 21 for а>1 
n9 
4 lim Уп = 1. 
n- оо 
5 lim —— =e [Е (6.36). 


6: "inim mot 

н п» (n+ 1) (и+2)...21 4 
Бао Ы 

7o tim МУ ш], 


п—> оо п 
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8. For p> 1 
А п п \? n M 1 

e ee + 

9. For « > 0. 

G—1_ 94-1 1-1... 49—1 —-]ym-1542-1 

lim | 297143 4 esp lying = 0. 
т = n 

10. If we write 

Am ажат тщ and С, = Vaga... Gnas 


we have, with a, = CË: 


lim 4, = 2, lim VG, = Je. 
п оо n=> оо 

11. If the above notation is retained for A, and G,, we have 
with а, = a+kd(k = 0, 1, 2, ...),a>0,d>0: 


3. Fundamental theorems concerning limits 


1°. A sequence can have only one limit. 

2°, If a sequence has a finite (infinite) limit, it is bounded (non- 
bounded). 

3°. If a sequence (x,) has a unique limit point x, the sequence is 
convergent and хо is its limit. Conversely, if a sequence (x,) is convergent 
to Xo, Xo is its unique limit point. 

4°. If x is a limit point of a sequence {a,}, there exists И 
{a,,}, convergent to x. Conversely, if y is the limit of some subse- 
quence {a,,}, y is the limit point of the sequence (a,). 

5°. Similarly, if x is a limit point of a set M of the numerical axis 
E, M contains a sequence (x,) of numbers different from x that con- 
verges to x. 


6°. On the assumption that lim x, and lim y, exist, we have: 
п co п ое 
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lim (x, Ł Yn) = lim x, + lim у, 
n— оо N—> co n=> оо 


lim (x44) = lim хь. lim ул, 
п co п> оо п со 


lim x, 
lim 22 = 222 where lim y, 0 
im Z = 220 ; 
п-» оо Уп lim Ул : n оо ^ 
n> оо 


4. Some propositions on limits 


1°. Jf lim a, = a and all the a; > 0 (i = 1, 2,...), then 


"n— оо 

; 2o d dd... 
lim Va ...a, a, lim 22211053 ы 
п» во п> оо п 


2°. If A is the greatest of the numbers 


dy da, ..., An (а; = 0) 
апа 
pi-0212,3,..., п), 

we have 

lim "руат pa? 4- ... Брат = А, 

т- < 

иш AD ра А+... -+рат“! _ 

т PA +Р@ +... НР, 


3°. If, for а sequence {a,}, 


and 


both exist, then 
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4°, If 


Pn 


lim —— —————— = 0, 0, 
п-> = Pot Pit +++ + коа 


and, as n — œ, s, has a limit equal to s, we have 


lim SoPn tS Pn—1tSePn—2t +++ SnPo s 
п оо PotPitPat Ps 


5. Оррег and lower limits of а sequence 


The upper (lower) limit of a sequence {x,} isthe strict upper (lower) 
bound of the set numbers which are limits of the sequence, and is 
written as 

lim x, ( lim ^) 
п оо I o6. 


For example, 


im [+2] =i, 


lim [ev] = -1, 


п» оо 


while at the same time, 
1 3 
su = 0)"+— | = +, 
КИ J 3 2 


inf [ev ere 
nel, 2... п 

Every bounded sequence has an upper and a lower limit. 

If a sequence is convergent, its limit coincides with its upper and 
lower limits; if the upper and lower limits are the same, the sequence 
is convergent to their common value. 

Given any sequence that has an upper and a lower limit, we can 
readily form monotonic sequences convergent respectively to the 
upper and lower limits: a monotonically non-increasing {x,,} to 
the lower, and a monotonically non-decreasing {x7} to the upper: 
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хӯ = Sup {Xm Хи Хань ++ eds 
Xen = inf (xy, Ха+1› Мин ++ Jj 
lim x, = lim м, lim x, = lim x4. 
` n-x99 A— ә ‘hopes п» оо 


If {x,} is a monotonically non-decreasing (non-increasing) sequence 


+ * + 
and а= lim x, then хо = X, Xen важ = a, Xan = X). 
n> оо 


6. Uniformly distributed sequences 


Let the sequence {x,} lie on the segment [a, b}. 
Let N, (x, B) denote the number of the points x, (Е = 1, 2,..., п) 
which lie in the interval (x, В) c [a, 5]. If the limit 
Мух, В) 
п 


=0= 8-х 


exists, then no matter what the interval (x, В) с [a, b], the sequence 
is said to be uniformly distributed on the segment [a, b]. 

EXAMPLE 18. The sequence {y,} of EXAMPLE 11 (see § 2, sec. 7) 
is uniformly distributed on [0, 1]. 

EXAMPLE 19. The sequence {x,}, where 


Xa = an — [an], а> 0, O<a<1 (п = 1,2, ...), 


([x] is the integral part of x) is uniformly distributed on (0, 1]. 
EXAMPLE 20. The sequence (x,), where 


ха = adnnm*-[ae(lnnmv] а> 0, с> 1 (п = 1, 2, ...), 


is uniformly distributed оп the segment [0, 1]. 

Uniformly distributed sequences have applications in numerical 
integration. Obviously, all interior points of the segment [a, b] 
are limit points for {x,}, and moreover, 


а= lim хь, b= lim x. 


п» 5 no 


Given any function f(x) continuous on [а, b], and a sequence {x,}‘ 
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uniformly distributed on [а, b], the following relationship holds: 


Conversely, if this equation is satisfied for all functions continuous 
on [a, bj, then the sequence (x,) is uniformly distributed. 


7. Recurrent sequences 


A sequence (x,) is said to be given bya recurrence formula if the 
first few terms are given and a formula is known, with the aid of 
which x, is expressible in terms of the preceding terms: 

Xn = Ихи-ь Xn-2) sees Xn-p) р=1(п= 1, 2, .. Э. 
For instance, x, = 1, № = 2, x, = x, 19 x4 (п = 3, 4, ...). 

The sequence itself is sometimes described as recurrent. 

The simplest example of a recurrent sequence is an iterative sequ- 
ence {x,}: 

Xn = Их). 
Iterative, and in general recurrent, sequences are of great value in 
approximation methods — for example, in the method of successive 
approximations and Newton’s method. 

(a) The method of successive approximations for solving the equa- 
tion x = f(x), where f(x) is a continuous function, leads to an iter- 
ative sequence {x,}: 

Xho = {х} (К = 0, 1, 2, oe .), 
where some arbitrary number is taken as хо. Here, if the sequence 
{хь} is convergent to x, x proves to be a solution of the equation: 
x = f(x). 

(b) Newton’s method (or method of tangents) for finding the roots 
of the equation f(x) = 0, where f(x) is a differentiable function, 
also leads to an iterative sequence {x,}: 

Xk+1 =La (k=01,2,..), 
where some number is taken аз хо; here, if {x,} is convergent, then 


lim x, = x is the required root, i.e. f(x) = 0. 
k= co 
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(See above, for a sufficient condition for the convergence of the 
sequence {x,} indicated in method (a).). 


8. The symbols o(x,) and O(z,) 


A variable that takes a certain sequence (x,) of values is called a 
variant. For instance, the variable term of any progression is a variant. 
If a, and B, are given variants, while their ratio «,/f,, tends to 


Zero as n — | lim «,/f,, = 0), we say thata, (B,) is an infinitesimal 
7—5 оо 


(infinitely large quantity) with respect to B, («,) and we write sym- 
bolically: 

Zn = о(В„). 
For example, 1/n? = o(1/n), п = o(r?). 

If о, B, are infinitesimals and о, = o(f,), we say that а, (Ba) 
is an infinitesimal of higher (lower) order with respect to B, («,), 
or «, (б) decreases faster (more slowly) than B, (x,). If аи, В, are 
infinitely large quantities, and х, = o(f,), we say that о, (Ba) 
increases more slowly (faster) than B, (х„). 

If |a,|= С16,1, C>0 (C is a constant), we say that 8, has а rate 
of decrease not faster than x, or that «, has a rate of increase not 
faster than В„ and we write symbolically: 


ап = О(В„). 
In particular, if lim «,/B, = C #0, then a, = О (В,) or 


В, ER O(z,). п> co 


For example, n =0(V +1). 
The equation 
ап = O(1) 
implies that the sequence {«,} is bounded, i.e. that |x, | = C for all n. 
THEOREM 3. Given an arbitrary sequence {X,} = {xh} of the 
following sequences: 
Жу = (xh, ео, 
Keg 185 08,008 boy Ry 0}, 
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there exists a numerical sequence X = {xp} = {Xy xy... Xp...) 
increasing faster (decreasing faster) than any of the sequences {xp}. 

For example, if X, = (m") = (ml мё, mh...,m",... the 
sequence X = (m!) = (11, 21, 31, ..., m! ,. . .) increases at a faster 


rate than any sequence (X,): lim n"/m! = 0 for any n. 
m— оо 


9, Limit of а function 


Let the function f(x) be defined on some set X. We say that the 
number A is the limit of f(x) as x — xq: 
А = lim f(x), 
x xo 
or that f(x) tends to A as x — хо, if, given any sequence (x,) € X, 


convergent to x, ( lim x, = x), the sequence (f(x,)) is convergent 
fie 
to A. Or, in other words, the number А is the limit of the function 


f(x) as x — xg: 


A= lm f(x (К) 4 as x- Xp), 
ex 


x> xy, X 


if, given any positive number e, there exists 6 > О such that | f(x)— 4 |< 
«e for all x € X such that 0 = |x—x,|< à. For example, 


.. sinx . tanx . 1—cosx 1 
lim — = 1, lim —— 21, Ит————с=-—, 
x9 X ко X ао X 2 

lim 26 шх=0 for any « > 0. 
x70 


10. Right and left continuity of a function 


We shall consider functions у = f(x), defined on sets X of E; 
X will usually be a set such as 


СА 5), (©, В), [а, 5), (>, B). (— е, + со), (— =>, 0], 
[0, + e), (— е, 0), (0, + =), 
еїс. 
Let f(x) be defined on an interval (хо, а). The number А=Дх-+ 0) 
is called the limit of the function f(x) from the right at the point xy Ху 
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if, given any sequence {x,} of (хо, а), convergent to хо, f(x,) is con- 
vergent to A. We can similarly define at the point x = x the limit 
from the left f(xy —0) = В of f(x), defined in an interval (b, хо). 
For example, we have for the function y = E(x) (see § 2, sec. 1) 
and for the integral argument x = n: E(n—0) = n— 1, E(n4-0) = n. 
When the argument x, = 0, the limits from the left and right of f(x) 
are written respectively as /( — 0) and f(-- 0). For example, if f(x) = 
= sign x (see $ 2, sec. 1), then f(—0) = — 1, f(+0) = +1. 

A function f(x), defined at а point x = хо, is continuous there 
from the right (left) if хо + 0) [Хх —0)] exists, equal to f(x). 


11. Continuous and discontinuous functions 


If 
/©у—0) = Д(%+0) = Аж), (1.12) 


the function f(x) is said to be continuous at the point x = хо. If f(x) 
is not defined in the interval (b, хо) ог (Xo, а), the left- (or right-) 
hand term in (1.12) is ignored. (See also p. 59). If f(x), defined on the 
set X, is continuous at every point x € Х, it is said to be continuous 
on the set X. 

For instance, f(x) = NT] is continuous for all x = 0. 

Otherwise, f(x) is described as discontinuous. We say that (f(x) has 
a discontinuity of the first kind or jump at the point x xy if f(x, — 0) 
and f(x, + 0) exist, but (1.12) is not satisfied. In all other cases of a 
discontinuous function, the point x = x, is called a point of discont-- 
inuity of the second kind. For instance, the function 


—1 for |х|<1, 
Ie) - [71 for |х| = 
has a discontinuity of the first kind at the points x, = —1 and 
ж = +1. 


Certain commonly encountered functions у = f(x) are equal, 
at a point of discontinuity of the first kind х = хо, to the arithmetic 
mean value 


(xo) = хо = 0) Ло + 0) А 
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For example, in the case of f(x) = sign x (see $ 2, sec. 1): 


We say that f(x) is uniformly continuous on the set X if, given any 
€ > 0, there exists а 6 = б(є) > 0 such that, for any pair of points 
x', x" € X for which f(x) Баз а meaning, |х – х” | < óimplies | f(x) — 
—f(x")| = e. A function f(x), defined and continuous on a bounded 
segment [а, b] is uniformly continuous on this segment (Cantor's 
theorem). 


12. Functional sequences 


Ап important role is played in analysis by functional sequences 
{h} (n = 1, 2, ...), defined on some set X of the numerical 
axis E,. Various definitions can be given of passage to the limit for 
such sequences. It is natural to start from passage to the limit at 
each point, when (f,(x)) becomes a numerical sequence for any 
fixed x € X. If the sequence (/,(x)) is convergent as n + e» for any 
x € X, its limit depends on the point x € X, i.e. is a function f(x) (a limit 
function), and this is written as 

Љо) zm fo») or „Ша Лб) = f(x) xex. 


EXAMPLE 21. -5 for x<0, 
lim arctan nx = Zsiga 2 = 0 for х= 0, 

N—> +00 = 
5 for x>0. 


This example shows that the limit of continuous functions may be 
a discontinuous function. 

As a result of a double passage to the limit, functions can be 
obtained in the limit that have even more complicated discontinuities, 
for instance, 

lim lim (cos 27m! х)" = x(x), 


те N- ос 
where у(х) is Dirichlet's function: 
_ [1 if x is rational 
х9 = | O if х is irrational. 
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Remark. Together with functional sequences, we often encounter 
in analysis sequences of numbers, dependent on functions (functionals) 
For instance, the mean values of functions are defined by the limits 
of such sequences, 


If the function f(x) is integrable on [a, 5] and fm = f(a+vé,), 


ðn = = , then 


п = 


ba ky ee 1 f d 
lim = Ли = ges | 94 
is the arithmetic mean of f(x) on [a, b]; 


P 
Jim Yoa Fa = ею} gs] лда 


is the geometric mean of f(x) on [а, b], and 


Я п [Na b ах \-1 
мл) =®-®(| де) 


is the harmonic mean of f(x) on [a, 5]. 
The following also holds: 


THEOREM 4. If functions f(x) and g(x) are continuous and positive 
on [a, b], then 


а) Jim | ] од dx = mex Ло, 


| " gG9 L/int? dx 
(2) lim 5——-—— —————— = max f(x) 
jos | a(x) А)" dx xe [a,b] 


13. Uniform convergence of functions 


The concept of a uniformly convergent sequence of functions {f (x)} 
plays an exceptionally important role in analysis. 

DEFINITION. 4 sequence of functions {f,(x)}, defined оп a set 
X C E, is said to converge uniformly as n — œ to the function f(x), 
also defined on the set X, if, given any positive number s, an integer 
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М = N(e) can be found, independent of x € X, such that, for alin > N: 
|f.) ХО) | = а, (1.13) 

If {f,(x)} is convergent as n — oo at every point x € X, but does 
not satisfy the uniformity condition (1.13), we say that {/(х)} 
converges non-uniformly to f(x) on the set X. With non-uniform 
convergence, the number № depends not only on the choice of e, 
but also on the number x € X: 

N = Ne, х). 

THEOREM 5. Jf all the functions f(x) of a sequence {f,(x)}, uni- 
formly convergent to f(x) on X as n — «e are continuous, the limit 
function f(x) is also continuous on X. 

It follows from this that, if the limit function is discontinuous, 
the convergence as и + œ of the sequence (/,(X)). is non-uniform, 

EXAMPLE 22. The sequence {f,(x)} = (x") is uniformly convergent 
аз n> c to f(x) = 0 on any segment [0, 9], 0 = а < 1; on the 
segment [0, 1] this sequence converges non-uniformly to the function 


0 for 0zsx-«l 
wii for х=1. 


у у= +8 


Fie. 1. 


Caucuy’s Test. A necessary and sufficient condition for a sequence 
of functions у(х), defined on a set X с E, to be uniformly convergent 
аз n > co to a function f(x) is that, givenany e > 0, there exists an N, 
depending only on е, such that |f, (x) —/4(x)] = = for all x € X, 
provided only that n > № and т > М. 
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Geometrical interpretation of uniform convergence. Let f(x) (n= 
= 1, 2,...) be continuous in [a, b], and let the sequence {f,(x)} be 
uniformly convergent as n - ое to the function f(x), continuous in 
[а, b]. Now, all the curves у = f,(x) fall within ап e-neighbourhood 
ofthe curve у = f(x) when n > М (see Fig. 1), i.e. they are contained 
in the strip between the curves y = f(x) — e and y = /(х)+ e. 


14. Convergence in the mean 


A functional sequence {f,(x)} is convergent in the mean on the 
segment [a,b] C E, as n ~ œ to the function f(x) if, given апу 
€ > 0, there is a number № such that, for all n > М, we have 


| " LAG) — OP dx < e 


(it is assumed that this integral exists). 
Use is often made of convergence in the mean in various branches 
of analysis (for instance, in the approximation methods of analysis). 
Convergence, defined by the norm of a space (see Chapter IL, $1, 
Sec. 2), is a generalization of convergence in the mean. 


15. The symbols o(x) and O(x) 


Given two functions x(t) and y(t), defined on a set X, if their ratio 
x(t)/y(1) tends to zero as t+ a € X (lim x(t)/y(t) = 0), we say that 


ima 
x(t) D(A] is an infinitesimal (infinitely large quantity) with respect to 
y(t) [x(2)] and we write symbolically: 


x(t) = oG(). 


For example, {2 = o(sint) as t — 0, t" = ofe') as t— e for 
any n > 0. 

If x(t) and у(/) аге infinitesimals as t — a, and x(t) = о(у(ї)), 
we say that x(t) ((t)) is an infinitesimal of higher (lower) order 
with respect to y(t) (x(t), or: x(t) (y(t)) decreases faster (more slowly) 
than у( (х(1)). 

If x(t), y(t) are infinitely large quantities as f + а, and x(r) = о(у(1)), 
we say that x(t) (y(t)) increases more slowly (faster) than y (t) (х(1). 
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If | x()| = C| (| (С 15 a positive constant), we say that x(t) does 
not decrease at a faster rate than y (t) or that x(r) does not increase 
at а faster rate than y(t), and we write symbolically: 


x(t) = 000). 
For instance, # = O(t sin(1/t)) and t = O(tan 21) as t + 0, 


1 
е = oles’) and e = О(е?+Т) as г =. 
In particular, if lim x(1)/y(t) = С = 0 (C is a constant), then 
t—a 


х@) = OWN) and у@) = OA). 


THEOREM 6. Whatever the sequence of functions f (x), defined т 
"the neighbourhood of a point x = a, there always exists a function 
ф(х) Е M, decreasing (increasing) faster then any of the f(x) as x — а. 


16. Monotonic functions 


A function f(x) is described as monotonically non-increasing (non- 
decreasing) on a set X (e.g. on [a, bJ), if, given any points x,, x € X 
such that x, = ху, we have f(o;) = Ax) (Их!) = Лха). A function 
f(x) is said to be monotonically increasing (decreasing) in the strict 
sense (or to be strictly monotonic) if Kx) = f(x) (fo) > Kx) 
for any xj, x; € X for which x, < x. 

Functions monotonically non-increasing, monotonically non- 
decreasing, and strictly monotonic are all described as monotonic. 

When f(x) is monotonic, it always has limits from the left and 
right at a point of discontinuity x = хо; if f(x) is non-increasing, we 
have 


J(xo 0) = f(xo) = f(xo 4-0); 
if f(x)is non-decreasing, 
fo — 0) = f(xo) = f+ 0). 


Let y — f(x) be a monotonically increasing (decreasing) continuous 
function, defined in a segment interval or semi-interval X € Ej, and 
mapping X into a segment, interval or semi-interval Үс Æ; 
an inverse x — g(y) of f(x) now exists, defined on Y. The function 
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9(y) is continuous on Y and is monotonically increasing or decreasing 
along with f(x). For example, the function у = x? in the semi-interval 
(0, + х) has an inverse x = Му in (0, + =). 


17. Convex functions 


A function f(x), defined on a set X (a finite or infinite interval, 
semi-interval, segment) is described as convex if, given any numbers 
Xj, X9 € X, we have 


I 
ДА) = ләләр 
f(x) is described as concave if the reverse inequality is satisfied: 
- 1 
ДА") = guo fei 


This means geometrically that, if f(x) is convex, по агс of the curve 
у = f(x) lies above the chord subtending it, whereas if f(x) is concave, 
no arc of the curve у = f(x) lies below the chord subtending it. 

For example, the functions | x |, x?, ех, x J- | x| are convex, while the 
functions — |x|, Vx, — e^* are concave; the function y = x*(x > 0) 
is convex х = 1 and а = 0 and concave for 0 < х = 1. A necessary 
and sufficient condition for a function f(x) to be convex оп [a, 6] is 
that, given any numbers x, хз, хз satisfying a = x, = x, < x3 z b, 
the following inequality holds: 


x, f(x) 1 

х Дх) liz 0. 

хз Хх» 1 

If f(x) is continuous (even only from the right) and f(x) = i [f(x— 


— h) - f(x 4- h), it is convex. 


x 
If f(x) is monotonic in [a, Б], | ДЕ) d£ is a convex function. 


a 
It must be borne in mind that the graph of a convex function faces 
downwards, ie. it is a concave curve in the accepted geometrical 
terminology. 
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Convex functions have the following properties: 

1°. A convex (concave) function f(x) is continuous at every point 
of its domain of definition. 

2°. If f(x) is convex, —f(x) is concave on the set X. 

3°. A convex (concave) function f(x), not equal to а constant on 
the segment [a, b], cannot attain a maximum (minium) inside [a, 5]. 

4°, If f(x) is convex (concave) on [a, 5], and /(x) is a linear function, 
where (а) = f(a) and ҚБ) = f(b), then either f(x) = I(x) (Ax) = Кх)) 
at every point of (a, b), or f(x) = K(x). 

5*. A linear combination of convex functions with positive coeffi- 
cients is a convex function; in particular, the sum of a finite number 
of convex functions is a convex function. 

6°. If Ди) is а non-decreasing convex function, while и = ф(х 
is a convex function, f [p(x)] is a convex function of x. 

7°. The inverse of a decreasing (increasing) convex function is 
a convex (concave) function. = 

8°. If f(x) is convex on [a, Б], given any positive numbers p; — 0 
(i = 1, 2,..., n) such that р; +р+...+р, = 1 and any points x,, 
хь. ++) Xn on the segment [a, b], we have 


JPX pax o... Краха) == р(х) + pif)... M pa fixa). 


9°, Any convex function f(x), satisfying the condition f(x,) = 0, is 
expressible in the form 
x 
Ле = | КТ? 
хо 
where p(t) is а non-decreasing function, continuous from the right. 
A function g(x), defined on a set X с E,, is described as logarithm- 
ically convex if log ф(х) is a convex function, і.е. if 


х-х 


#(AZ*) = еб 


for any xı, x, € X. A logarithmically convex function is a convex func- 
tion. For instance, the function ф(х) = x log x is logarithmically 
convex for х> 0; ф(х) = е** is logarithmically convex for all x € 
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€(— œ, + 9); ф(х) = x* (kis an integer) is logarithmically convex for 
X€(— е, +o) and even k з 0, for x€ (0, + ә) and апу k #0; 
Г(х) = | re^ dt is logarithmically convex for x > 0 (concerning 


a 
the function T(x), see Chapter VI, $ 4, sec. 5). 


СНАРТЕК П 


n-DIMENSIONAL SPACES AND 
FUNCTIONS DEFINED THERE 


Introduction 


We considered in Chapter I functions ofa single variable as functions 
of a point of the numerical axis Ej. Similarly, functions f(x, у) of two 
variables can be regarded as functions of a point of the plane E; with 
coordinates x, y, and functions f(x, y, z) of three variables as functions 
of a point of space E, with coordinates x, y, 2. 

About the middle of the last century, coordinate space of п dimen- 
sions was introduced into mathematics, and functions of n variables 
came to be regarded as functions of a point of n-dimensional space. 
At the same time, various concepts of ordinary two- and three-dimen- 
sional geometry were generalized to n-dimensional spaces. 

This generalization proved to be not merely formal. Our geometrical 
intuition can be carried over to multi-dimensional entities, and the 
treatment in geometrical terms of the problems of analysis and algebra 
of n dimensions led to greater clarity. Geometrical intuition sometimes 
enables us to discover the facts in n-dimensional geometry, which can 
be interpreted as corresponding facts of analysis and algebra. 

In the present chapter $ 1 deals with the theory of n-dimensional 
spaces, and in particular with the theory of orthogonal systems of 
vectors, which is an elementary analogue of the more complicated 
theory of systems of orthogonal functions, discussed in Chapter IV. 

Section 2 is devoted to passage to the limit, continuous functions 
and continuous (in the generalized sense) operators on them in n- 
dimensional space. It is directly related to Chapter I, in which we 
discussed the same topics for the particular case n — 1. 

Section 3 gives a treatment of one of the branches of n-dimensional 
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geometry — the theory of convex n-dimensional bodies, which, apart 
from its geometrical interest, has acquired importance in a number of 
applied mathematical problems. It should be remarked that no great 
simplification is obtained by confining the discussion of convex 
solids to three-dimensional rather than n-dimensional space; and in 
fact, it is precisely the theory of convex bodies in space of a large 
number of dimensions that has acquired practical applications. 


$ 1. n-dimensional spaces 


1. n-dimensional coordinate space 


An element X of an n-dimensional space E, is defined as а set of 
n numbers xy, Xs, ..., Ха. It is written as X(xy, Xo, ..., Хх) or X = 
=(х,, Xs... Xn). The space E, is the set of such elements. 

Elements of the space E, are treated in two ways: on the one hand, 
they are regarded as points with coordinates ху, x», ..., Xn, on the 
other, as vectors with coordinates ху, xy, . . ., x, (n-dimensional vector 
Space). We shall start by using the first treatment. 

There are various ways of introducing distance or a metric into 
the space E, (see, for example below, § 3, sec. 3). The most com- 
mon is the following (Euclidean) metric: the distance o(X, Y) between 
the points X(xy, X», ..., Х|) and Y (yy уз... Yn) of E, is defined as 


the number 
«X, Y= |y Qi». (2.1) 
і=1 


The space E, with a distance introduced in this way is called n-dimen- 
sional Euclidean space. 

Formula (2.1) reduces to the formula for the distance between two 
points in analytical geometry when n = 1, 2, 3. 

We write 0 for the point with zero coordinates: 0 = (0,0, ..., 0) 
(the origin of coordinates). We have 


o(X, в) = | y. (22) 


i=l 
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The distance thus introduced has the following properties: 
(1) eX, У) 20, where o(X, У) = бошу when X = Y; 
(2) «X, У) = «X, У); 
(3) «X, У) = e(X, Y)-- (Y, Z) 


(the triangle inequality). 
An attempt is generally made to preserve these properties in 
generalized concepts of distance. 


2. n-dimensional vector space 


The n-dimensional space Е„ can also be regarded as a vector space. 
The operations of addition and multiplication by a scalar (number) 
can be performed on vectors in the plane E, and in three-dimensional 
space Es. Every element X (ху, xs, . . ., Xn) of E, will be regarded as a 
vector with coordinates Xy, Xo, ..., X. 

The sum of two vectors X (х1, Xa, ..., Xn) and Y (у, у... Yn) 
is the vector Х-- Y of E, with coordinates ху, Xo Ya, . . e Xn Уи. 
The difference X— У is similarly defined. 

If А is a number (scalar), and X(xj, Xz, . . ., Xp) is a vector of Ep, 
АХ denotes the vector of E, with coordinates Аж, Ax, ..., Ax, 
Vectors X and AX are described as collinear. Linear operations on 
vectors reduce to linear operations on their coordinates. 

The zero point 0 corresponds to the zero vector 0 with components 
equal to zero. Obviously, X--0 = X, 40 = 0. 

The vectors 


e(l, 0, 0,..., 0), ex0, 1, 0, ..., 0, ..., &n(0, 0, ...,0, D) 
or alternatively, 
еб, ёз, ++ +s др... бы), 
where д, is the Kronecker delta: 
0 for ij, 
Tli for i=j 
J 
are called unit vectors. The following equation holds for any vector 
X = (х №... Xp)? 


n 
= X хе; 
i=l 
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The norm || X || of the vector X is the number 


х= /ў ox (2.3) 
1=1 


equal to the distance о(Х, 9) from the point X to 0. 
The norm of a vector satisfies the conditions: 
(1) [Х| 20, where ||Х| = 0 only when Х = 6; 
(2) ПАХ = ТАТАХ; (2.4) 
(3) IX YI = ИХ + У. 

The distance o(X, Y) between elements X and Y, introduced in 
accordance with (2.1), is the same as the norm of the difference be- 
tween the corresponding vectors 

aX, Y) =ИХ-У|. Q.5) 

The sphere S(X,, r) in E, of radius г with centre at X, is the set of 

points (vectors) X, for which 

e(X, X) = НХ-Х || < г. 
If we introduce for sets in E, the notation introduced in Chapter I, 
§ 2, sec. 2, we have 

S(Xo. г) = (000, Xo) = г). 


3. Scalar product 


In analogy with the two- and three-dimensional case, the scalar 
or inner product of two vectors Х(ху, x4, ..., Xn) and Y(yy Yo... Vn) 
of E, is defined by the equation 


п 


ХУ = (XY) = Y х. (2.6) 
{чї 
The elementary properties of scalar products are: 
(1) XY = YX; 
(2) XX = ХР = 0. 


CAUCHY'S INEQUALITY. Given any two vectors X(xy, xa, . . ., x,) and 
Кул, у»... Уһ) Of Ens we have 


[XY] s | ХУП (2.7) 
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or 
Evol = Dado. en 


Equality holds in formulae (2.7) and (2.7') if and only if the vectors 
X and Y are collinear (i.e.if X = 6 or if Y = AX, i.e. if all the x; = 0 
or y; = Ax; (i = 1,2,..., n). 

The angle between two vectors. Let Хх, x4, ..., Xn) and УС, 
У»... Yn) be two vectors of E, different from 0; the angle p between 
them is given by 

xy 
COS Ф = ——— 2.8 
? diu» Ce 
In view of (2.7), |cos p| = 1. 

The projection of the vector X on to the vector Y is given in magnitude 

by 


ЖУ ш Д 
TESI I] х|| cos e. (2.9) 


When || У||= 1, the projection of vector X on to Y is equal in magnitude 
to their scalar (inner) product: 


XY = || X ll cos g. (2.10) 


EXAMPLE 1. The magnitude of the projection of the vector X(x,, 
№... Xp) on tothe unit vector e;(i = 1, 2, .. ., л) is equal to the 
coordinate x; of the vector X. 


4. A linear system and its basis 


An n-dimensional vector space is a particular case of an n-dimen- 
sional linear system. 

A linear system L is a set of elements to which we can apply the 
operation of addition, ie. the operation of finding a new element 
ccL from two elements а, b c L, c = a+b, and the operation of 
multiplication by a real number 4, i.e. the operation of finding from 
an element a€ L and a number A an element d = Aa € L. These 
operations have the following properties: 
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(1) (@+b)+e = a+(b+0); 
(2) a+b = Б+а; 

(3) Аа) = (Aga; 

(4) A(at+b) = 4+4; 

(5 (2+ 2)а = да+ Aa; 

(6) 1.а= a; 


The system L possesses а zero element 0, for whicha+@ = а, 0.а = 0 
for ac L. | 

Linearly independent elements. Elements ху, xs, ..., x, Of a linear 
system are said to be linearly dependent if there exists a set of numbers 
Су, С»... Ср, NOt all zero, such that 


сах; + CX d- ... + Сах = 9; (2.11) 
if there is no such set of numbers, i.e. if (2.11) is satisfied only with 
€ m С =... = с = 0, 


the elements ху, Xs, ..., x, аге said to be linearly independent. 
EXAMPLE 2. On a plane, the vectors X, (1, 1) and X, (2, 3) are line- 

arly independent, while the vectors X, (1,1) and X; (3, 3) are linearly 

dependent (since 3X,— Хз = 0). In three-dimensional space, the 

vectors Y, (1, 0, 0), У, (1, 1, 0) and Y, (1, 1, 1) are linearly independent; 

the vectors Z, (1, 0, 0), 2, (2, 1, 1) and Z; (3, 2, 2) are linearly dependent 

since ` 

Z,-2Z,+Z; = 0 


A linear system is described as n-dimensional if it contains n line- 
arly independent vectors, and any n+1 elements of it are linearly 
dependent. A linear system is said to be infinite-dimensional if it con- 
tains any number of linearly independent elements. An n-dimensional 
vector space is an n-dimensional linear system. 

The set of solutions of a linear homogeneous differential equation 
forms a linear system. In the case of an ordinary nth-order equation 
this system is n-dimensional; in the case of a partial differential equa- 
tion the system is infinite-dimensional. 

The basis of an n-dimensional linear system L, is any set (e, e, . . ., 
ел) of n linearly independent elements. 
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Any element 1 of the system L, is linearly (and uniquely) expressible 
in terms of the elements of the basis: 


Г = җе d Xet -oo + же; (2.12) 


the elements хе; (i = 1, 2, .. ., п) are called the components with re- 
spect to the basis (ej, ез, . . ., e,) while the numbers x, are the coordi- 
nates with respect to this basis. 

EXAMPLE 3. The unit vectors е; form a basis in n-dimensional vector 
space: 


еу = (1, 0,0,..., 0), е = (0, 1, 0,..., 0), ... 
wees ё = (0, 0,..., 0, D. 


An n-dimensional linear system can be regarded аз an n-dimensional 
space, in which the elements of the basis play the part of unit vectors. 


Examples of n-dimensional linear systems. Linear systems of functions, for 
which addition and multiplication by a number are understood in the ordinary 
sense, are aften encountered in analysis. We shall quote some examples. 

(1) The (#+1)-dimensional system of polynomials 


п 


Р(х) = У сх? 
ke 
of degree not higher than л. The system of powers 
sae ae oat aie a 
can be taken as the basis, as also can any system of polynomials 
Р, = 1, Рх) = х+аь, 
k-1 
Py) = x*tagxtdy s Pi) = + a sss, 
is 
? n-i 
es P) = x" 4 У ах. 
i-0 


(2) The system of homogeneous polynomials P, (xi Xz, ..., x4) of degree 
Кіп п variables ху, xs, . . . , x,, i.e. sums of terms of the form 


DC EE 


ki... 


where 


КА. +... +k, = К. 
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The basis of this system consists of all single terms of the form xhxh MEN xh. 
of degree k = k,--k,-- ... +h,. The number of such single terms (i.e. the number 
of dimensions of the system) is 

(л+К—1)! 

"EDU 


For instance, with n = 3, k = 3, the number of them is equal to 5!/3!2! = 10 
(the single terms are xj, xix, хха, Хы, XiXoXgs Xii XY, Xp ХА, X). 


If a system L, has one basis (е, ез, ..., е), it has an infinite set 
of bases. Let (ej, &,,..., ел) be another basis; then the elements 
e; of the old basis are expressible in terms of the elements ej of the 
new in accordance with 


e = У, «уе; G@=1,2,..., n, 


where the determinant |x, [L7 #0. An element / is expressible in 
terms of the elements of the new basis in accordance with 


n 

ia 

l= у җе. 
i 


The connection between the coordinates x; and x; of an element / 
with respect to bases (e,) and (e) is given by 
п 
ж = У ах; (1 = 1, 2,..., п). (2.13) 
j=l 
It follows from what has been said that the elements of any n-dimen- 
sional linear system L,, with basis (ej, ез, ..., e) can be regarded as 
vectors of an n-dimensional space in which the elements e; of the 


basis play the role of unit vectors. We shall confine our attention 
to such spaces in the present chapter. 


5. Linear functions 


A linear function or linear form in E, is a function ДХ) = f(x, x», . . ., 
хь), satisfying the conditions: 


(D ДХ+Ү) = Д(Х)—ДҮ). (2.14) 
(2) f(AX) = Af(X) where 4 is any number. (2.15) 
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If f(ej) = у; for the unit vectors e; (i = 1, 2, ..., n), then 


n n 
SX) = fy, ха, ..., Xn) = Ax ха) = У ух. (2.16) 
i=] im] 
The numbers y, are the coefficients of the linear form f. 
These coefficients can be regarded as the coordinates of the vector 
Y = (у, Yas ..., Yn) Of Ej; we now have from (2.16): 


ДХ) = YX. (2.17) 


The linear function f(X) is equal to the scalar product of the fixed 
vextor Y with the variable vector X. We usually say that the function 
JX) is generated by the vector Y. 

The scalar product XY is a bilinear function of X and Y: it is a 
linear function of X if Y isfixed, and a linear function of Y if X is 
fixed. А 

We have the equation 


IYI] = max УХ, (2.18) 


1.е. the norm of the vector У generating the linear form YX is equal 
to its maximum value on the unit sphere || X|| = 1. 
Criteria for linear independence. The Gram determinant for vectors. 
Let 

Ха җь..., Xin) (i= 1, 2,..., n) 


be vectors of the space E,. From them we form the following 
determinant: 


Ха дл... Xin 


A, Xa zie Mum do re т |. (2.19) 


THEOREM 1. A necessary and sufficient condition for vectors Xj, 
Хь.... X, Of E, to be linearly independent is that 


Д(Х X, ..., Xp) = 0. 


Gram's determinant Гү, х... x, of the vectors Xy, X, ..., Xm 
of £, is given by 
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(ХХ) AX) ... (Хул) 
XX) (%Х) ... ОХ) 


(ХХ) (ХХ)... OG XS) 


Gram’s determinant has the properties: 


@) Ixix... Xm Z 0; 
(2) A necessary and sufficient condition for linear independence 
of the vectors X,, X} ..., Xm is that 


Гх,ху... Xn > 0; (2.21) 


Pxix2... Xm = (2.20) 


(3) When m = n, 
Гу, х, veo, = AX. Xy +++, XF. 


See Chapter IV, §2, sec. 3 for the Gram determinant for functions. 

Manifolds. Let Ху, X,, ..., X, be linearly independent elements 
of E, (1 = k < п). 

А set of elements X of the form 


k 
X= X CiXi (2.22) 
i=l 
with arbitrary real с; is called a k-dimensional linear manifold. 

A one-dimensional linear manifold, i.e. a set of elements of the 
form X = Ax, (x, # 0) is a straight line passing through 0 and ху. 
Part of this straight line — the set of elements of the form X = Ax, 
A> 0, — is called a ray. 

A displaced k-dimensional manifold or k-dimensional plane is a 
set of elements X of the form 


À 
X = Х+ У aX; (2.23) 
iei 
with fixed and linearly independent X, X, .... X, and arbitrary 
values of the numbers су, cg, ..., с. It is obtained by displacement 
of the manifold (2.22) along the vector X,. A one-dimensional displaced 
manifold is a straight line: 

Х = XT tX, (— ә < fe + e). (2.24) 

We have for a straight line through the points X, and X3: 
X= (1-0) 1X, (— э <f< + о), (2.25) 
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The segment of the straight line joining points X, and X, is the set 
of elements of the form 


X¥=(-0)¥,4%, Ostal). (2.26) 


An (n— 1)-dimensional displaced manifold is called a hyperplane. 
Any hyperplane is given by an equation (i.e. is a set of points Х(ху, 
хә, »+ ++, Xn), Satisfying the equation) 


n 
ҮХ = у ух; = d, 4 (2.27) 
jul 
where YX is a linear form generated by the non-zero vector Y (уз, ys, 
-+ +s Yn). Conversely, every such equation defines a hyperplane. 
In general, any k-dimensional linearly displaced manifold (1 = k < n) 
is given by a system of equations 


n 2 
Ух = X х= d; (i = l, 2, өө п—К), (2.28) 
jel 


where the vectors Y, ( yu, Vig, «++» Yin) G = 1, 2, ..., n— К), generating 
corresponding linear forms, are linearly independent; in other words, 
every such manifold is given by n—k linear equations. Conversely, 
n—k equations (2.28) (with linear independence of the vectors Y;) 
define a displaced k-dimensional manifold. И all the right-hand 
sides d, — 0, we get a k-dimensional (non-displaced) manifold. 
In particular, the straight line (2.24) is given by n—1 equations (2.28). 


6. Linear envelope 


The linear envelope of a set M of E, is the least linear manifold 
containing M: in other words, the linear envelope of the set M is 
the set of all linear combinations of any finite number of elements 
of M, i.e. of elements of the form 


t 
УХ, XicM. 
im 


In particular, if X,, Xz, ..., X, are linearly independent elements of 
E,, their linear envelope is the k-dimensional linear manifold con- 


N-DIMENSIONAL SPACES AND FUNCTIONS DEFINED THERE 49 


sisting of all elements of the form 


k 
i=1 
Notice that, if the vectors Xj, X2, ..., Xp form a basis of the 
k-dimensional linear manifold E, of £,, we can supplement them by 
vectors Z,, Z5, ..., Zn- Ш such a way that the vectors Xy, Х„..., Ху, 
2ь 2, ..., Zp, form a basis in E,. Let E,_, denote the linear 
envelope of vectors L,. Every element Y of E, can be expressed (unique- 
ly) as 
Y= Х+2, (2.29) 
where 
А n-h 
X= Y Xi € Ep 2= У d;Z; € Es... 
iei j= 
Here, the space E, is the direct sum of the manifolds E, and £,_,, 
this being written symbolically as 


Е, = Е, + Ел. (2.30) 


Х and Z in (2.29) are called the components of the vector Y in Е, 
and Ёр. : 


7. Orthogonal systems of vectors 


Two (non-zero) vectors X and Y are said to be orthogonal if ХУ = 0 
(ie. if cos y = 0). The vectors X, X», ..., Xm form an orthogonal 
system if they are orthogonal in pairs, i.e. 

ХА;=0 for izj (2.31) 

The vectors of an orthogonal system are linearly independent. If, in 
addition, || X;|| = 1, the vectors are said to form an orthonormal 
System. In this case, 

0 for ij, 
ХХ; = бу = 2.32 
= И i=j. á 

The unit vectors ey, ез, ..., e, form an orthonormal system. 

In n-dimensional space E, there exists an infinite set of orthogonal, 
and in particular orthonormal, systems of л elements, but there are 
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no orthogonal systems of (n+1) elements. A system of п orthogonal 
vectors in E, forms a basis in E,, called an orthogonal basis. 

THEOREM 2. If vectors еу, ер, .. ., e, form an orthonormal system in 
Е. any vector X of E, is expressible (uniquely) in the form 


п 
X= уе, x; = Хе, (2.33) 
i=] 
n 
ИХ = Y x? (2.34) 
ia] 


The passage from unit vectors ез, €z ..., e, in E, to another 
* Li , LL Д 
orthonormal basis е1, ©, ..., e, in E, is called an orthogonal trans- 
formation. An inner product of vectors is unchanged in an orthogonal 
transformation, i.e. if 


k Lo n 5s 
Х=Уха= У же, Y= 2 ха = У уе. 
-1 


i=l 1-1 i=l 


then 


п п 
XY = Y xy = У х 
iei i=l 
In particular, the norms || Х| = Ухх (see (2.34)) of all elements 
of E, and the distance between any pair of such elements: o(X, У) = 
= ||Х-—У||, are unchanged by an orthogonal transformation. 
In general, if vectors ej ез, ..., e; form an orthogonal system, 
we have 


oy Pete эл Хе, р 
X= у} җе, м= ЧЕП” Q.33) 
п п 
НХ? = L xg Ife; IP = L (rej. Q.34) 


In analogy with the theory of orthogonal series (see Chapter IV), 
the coefficients х; in equations (2.33) and (2.33’) can be termed 
Fourier coefficients. 
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8. Biorthogonal systems of vectors 


Two vector systems Ху, Xz, ..., X, and У, У, ..., Y, of E, 
form a biorthogonal system if 


ХҮ 2 0 for izj, ХУ = 0 for i=j (2.35) 
Multiplying the vectors X, or Y, by constants, we can arrange that 
МУ; = 1 Gsl 2, iun) 


where the old notation is retained for the new vectors. In this case, 
every vector Z of E, can be written as 


п 
Z= xe oA ez, (2.36) 
i=l 
or as 
n 
2 = 2 WX = ZY; (2.36') 


Given a system of n independent vectors Xy, X», ..., X, in Ep, we 
can form a system of vectors Y,, Ys, ..., Y,, such that the two systems 
(Xi) and (Yi) are biorthogonal. If 


Xi = (Xin Xie s... Xin) and Yi = (Yip Yi +++) Ут), 


formation of the system {Y,} from the system (X;) amounts to 
formation of the inverse ||y;||h; of the matrix || xyli j. (See 
Chapter IV regarding orthogonat and biorthogonal systems of 
functions). 


i 
EXAMPLE 4. Let. X; = У € i= 1, 2, ..., n), where e; are unit 
jei 
vectors in E,; Y; = ej—e;,, (= 1, 2, ..., n- 1), Y, = e,. In this 
case (X) and {Yj} are biorthogonal systems in Е,. 


9. The projection of a vector on to a manifold 


Let E, be a k-dimensional manifold in n-dimensional space E, 
(i = k < n). The vector X of E, is said to be orthogonal to E, (written 
as X 1 Ep) if X is orthogonal to any vector Y of Ep, i.e. 


XY=0 if. ҮІ Бе. 
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A vector X, of E, is called the projection of the vector X on to E, 
if X— X, is orthogonal to Ер, 


Хо = рг.в, X. (2.37) 
We have: 
X= Ху+(Х—Ху), (Х—Х„) L Ер, XE 
when X € Ep to pr.g, X = X. 


If X € Ep PI.g, X = Х. 
Any vector X of E, has a unique projection on to Ep. 
If X, is the projection of the vector X on to Ep, we have 


(1) ПХ = ПУХ Xl, (2.38) 
(2) li x- Yi? = | X- ХР, (2.39) 


* where У is any vector of E,, and equality holds only when У = Xp. 
In other words, the minimum of | Х- У||2, where Y is any vector 
of Е, is attained when 


Y = X, = pr, X. 


Let U, з @ bea vector of E. We shall write E, for the set of vectors 
of the form tU, (- œ~ < + œ), i.e. the straight line Е, = 1U5. 
The projection of the vector X on to the vector U, is defined as the 
projection of X on to the straight line Ej, i.e. we have: 


(XT) Up 


TATE 9 


РГ. Х= 


and in particular, if || Uol] = 1, then 
Prvo X = (XUgU, = (| cos p)Uo, 


where ¢ is the angle between the vectors X and Up. 

Expansion (2.33) of a vector X into a system of orthogonal vectors 
e;G =1,2,..., n) implies the representation of X as the sum of 
its projections on to the ej. 

Let Ху, Xz ..., X, be orthonormal vectors in E, (К < n); they 
form an orthogonal basis in E, — their linear envelope. We can 
supplement them by the vectors X, 4j (/ = 1, 2, ..., n—k) such 
that the п vectors X, (i = 1, 2, ..., п) form an orthogonal basis 
in E, 
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Let X be any vector in E,; then 
k 
Pre, X= 2 Xi, а= ХХ. 
{= 


The sum of the first К terms in expansion (2.33) or (2.33’) is the 
projection of the vector X on to the linear envelope of the first k vectors 
X,@= 1,2, ..., п). 

Let the vectors {А} (i= 1, 2, ..., k< n) be orthogonal. Let 
k 2 


n 
us form all possible sums J, c;e;. The expression | Х-У c,e;|| attains 


i-1 im 

a minimum when с; = х, where c, is the "Fourier coefficient"; 
с; = XX, for || X, || = 1, while in the general case c, = ХХІХ, |l, 

THEOREM 3. Let {1} (i= 1, 2, ..., К) form a basis (generally 
speaking, not orthogonal т Е), and X be any vector of Ep; then 


k 
pra X = У 41, (2.41) 
= 
where 4, are given by the system of linear equations 
k 
У (LiL)d; = XL ` ES 25.24. (2.42) 
j=1 


the determinant of which is the same as the Gram determinant T. 
When k = n, the system (2.42) becomes a system for determining 
the components of the vector X with respect to the basis {L} (i = 1, 
2,..., A) 


§ 2. Passage to the limit, continuous functions and operators 


1. Passage to the limit in z-dimensional space 


Let L, be a linear system with a chosen basis, Every element X € L, 
is defined by its coordinates ху, Xp ..., X4, X = (Xy Xy ..., Xn) 
Let {Xn} = (X, Xy, ...) be a sequence of elements of L,, where 
Xm = (Xm Хто...) Xmn) The element X = (xy xs, ..., Xn) of Ln 
is said to be the limit of the sequence {Xm} if 

x, = lim xq (2.43) 


т—> ое 
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(i.e. if all the coordinates of X are the limits of the corresponding 
coordinates of the terms of the sequence {Xm}. We write convention- 


ally in this case 
X= lim X, (2.44) 


m— co 
and also speak of the sequence {Хи} converging to X. 

The coordinates of the elements {Xn} and X depend on the choice 
of basis in L,, but equation (2.43), i.e. (2.44) also, does not depend 
on the choice of basis in L,: if the coordinates of X,, tend to the 
corresponding coordinates of X in one basis asm — ce, this property 
will hold for any choice of basis. 

Ап n-dimensional linear system, in which passage to the limit is de- 
fined in the sense indicated, is called an n-dimensional linear space. 

In Euclidean, and more generally, in normed (see $ 3, sec. 3) spaces, 
where the distance between two points, or the norm of a vector, 
is defined, passage to the limit (2.44) can be defined as foliows: 
X= lim X, if 


mM > co 
lim (Xm Х) = lim ||Х„—Х]|| = 0. (2.45) 
т-— ос т —> оо 


Condition (2.45) is equivalent to condition (2.43). Thus, if we define 
the distance between two points or the norm of a vector (§ 1, sec. 1 
or 7) in a linear space, and make use of the definition of limit in 
accordance with (2.45), no changes whatever are introduced into 
the meaning of passage to the limit in Lt 

There will be no loss of generality if we consider in this chapter 
passage to the limit in Euclidean spaces E,. 

As in the one-dimensional case (see Chapter I, § 3, sec. 2), we 
shall call a sequence {Xm} of E, fundamental if, given any => 0, 
here exists N such that 

| Xm — Xm || = & 
for all т’ > М, т> №. 

A necessary and sufficient condition for а sequence {Xm} to have 
a limit is that it be fundamental. 

The concept of limit point (point of condensation) for a set М с E, 
is an immediate generalization of this concept for E, : X is called a 


t This introduction of a distance is called metrization of Ly. 
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limit point of the set M C. E, if it is the limit of some sequence {Xn} 
of points of M different from X. 

An equivalent definition is: X is called a /imit point of the set 
M ifany sphere S(X, є) with centre at X contains a point of М 
different from X. 

An analogue of the Bolzano- Weierstrass Theorem holds (see Chap- 
ter I, $ 3, sec. 1). 

Every bounded infinite set in E, has at least one limit point. 

An open set in E, is a set U of points of E, such that, if a point 
X belongs to U, there exists a sphere with centre at X contained in 
U. An open set is called a domain if any two points of it can be joined 
by a step-line, contained wholly in this set. 

Examples of a domain are as follows: on a straight line, a finite 
or infinite interval; on a plane, the interior of a circle, triangle, strip 
between two parallel straight lines, etc.; in three-dimensional space, 
the interior of a sphere, parallelepiped, cone, etc. 

An example of a domain in E, is a parallelepiped (a parallelepiped 
in Е, is an interval), i.e. a set of points X(x}, х, . . ., Xn) the coordinates 
of which satisfy the inequalities a; = x; = b; (i= 1, 2, ..., п), 
where а; and b; are given numbers. 

The intersection of any finite number of domains is a domain. 

A boundary point of a domain О in E, is a limit point of Q that 
does not belongto Q. The set of boundary points of Q is called the 
boundary of Q. A domain Q together with its boundary forms a 
closed domain (ог body) in E,. 

For example, the boundary of an interval (a, 5) consists of the 
points а and b, while the segment [a,b] is a closed domain; the 
boundary of a sphere S(X,, r) is the surface of the sphere, i.e. the 
set of points Y for which 


«X, X) = |F Gamay? = r 
i=l 


A closed set in E, is a set in E, containing all its limit points; for 
instance, closed domains are closed sets. 

THEOREM 4. The complement in E, of an open set (domain) is а 
closed set, and of a closed set an open set. 
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For example, the complement of the sphere (|| XI| = г) is the 
closed set (j| Х || = ғ), the complement of the closed sphere (|| X || = r) 
is the domain (|| X||> 7). 


2. Series of vectors 


The laws for passage to the limits of vectors (points) of n-dimensional 
space E, are essentially the same as the laws of passage to the limit 
in E,; the generalization to the n-dimensional case of the theory of 
conditionally convergent series (ie. series which are themselves 
convergent, while the series formed from the absolute values of their 
terms are divergent) is of some importance. 

А vectot series in E,: 


2 Х = +++... (2.46) 
=1 


is defined like a numerical series. 
If X, = (Xy Хы, «+ +> Ха), Series (2.46) corresponds to the k 
numerical series 


oo 


L хы = Xu Xat Xa... G@=1,2,..., п), (247) 
=1 


the terms of which are the coordinates of vectors Хь, i.e. of the terms 
of series (2.46), 
The partial sum S,, of series (2.46) is the sum of its first m terms: 


m 
Sm = n Х = Х\(+Х+...+Хм 
=1 


Series (2.46) is said to be convergent if its partial sums S,, are con- 
vergent as m — œ to some vector S, the sum of (2.46): 


S=} = lim Sp 


hel M—> оо 


The convergence of series (2.46) is equivalent to the convergence 
of all the numerical series (2.47). If S = (51,5, ..., Sp), then 


з= У Хы (= 1, 2, 3, ..., п). 
hel 
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Series (2.46) is described as absolutely convergent if the series of 
the norms of its terms is convergent: 


Ў ИЖ. 
REL 


The absolute convergence of series (2.46) is equivalent to the 
absolute convergence of the numerical series (2.47). 

Series (2.46) is said to be conditionally convergent if it is convergent 
non-absolutely. We have Steinitz’s Theorem, which is a generalization 
of Riemann’s Theorem (see Chapter III, $ 1, sec. 2). 

(1) Jf series (2.46) is absolutely convergent, its sum remains unaltered 
whenever the order of the terms is changed. 

(2) If series (2.46) is conditionally convergent, its sum can be altered 
or it can be made divergent by changing the order of the terms. 

(3) The sums of the series obtained by interchanging the terms of 
a convergent series (2.46) entirely fill some k-dimensional plane, 0 = 
z Кож n (see $ 1, sec. 5). 

For an absolutely convergent series, k = 0; for a conditionally 
convergent series, А > 0. 

EXAMPLE 5. Let x, = (-– 1) 1/0), and let s be an integer, 1 = s = n. 
Every positive integer т can be written in the form m = rs+k, 
where г is an integer, 1 S k = 5. Let Ym = X,,,, = x,e,, where 
ep (К = 1, 2, ..., з) are unit vectors. 

By changing the order in the series У Xm, we can now obtain as 


т 
the sum, any vector of an s-dimensional manifold E, — the linear 
envelope of the unit vectors ej, ез, ..., e, (see $ 1, sec. 6). 


3. Continuous functions of п variables 


Functions of a point (vector) of n-dimensional space. Functions 
of n variables may naturally be treated as functions of a point (or 
vector) of n-dimensional space. Let each point X (xy, x», ..., x,) 
of a set M in n-dimensional space E, be associated with a number 
ОХ) = f(y, xs ..., х); we now say that a function f(X) = f(x, 
хә,.., XQ) of a point (vector) X or a function of n variables —the coor- 
dinates of this point (vector) — is defined on the set M in E,. 
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The concept of passage to the limit is introduced for functions 
in E, as for functions of one variable. 

Let f(X) be a function defined on a set M C E, and let А be a limit 
point of M. We say that f(X) tends to a number a when X € M 
tends to A, if 


lim ДХ) = a. (2.48) 


for any sequence {X,,} of M, convergent to A. 
This is written as 


a= № F(X). (2.49) 
X— A(X € M) 


(If M is a domain and A an interior point, it has to be mentioned 
that X, tends to 4 while remaining in M.) 

There is another definition of such a limit, equivalent to the above: 
(2.49) means that, given any = > 0, there is a corresponding > 0 
such that, when 

0 = |Х—А4А||< and XEM 
we have 
|ДДХ)—а|< e. (2.50) 


Continuous functions. We take a function ДХ) = f(x, xs, ..., Xp) 
defined on a set M C E,, and а point X (xi, xs, ..., Xn) of this set. 
We say that f(X) is continuous at the point X € M if 

lim ХХ) = fX). (2.51) 
Cm € M 


т> ео, Хы Є 


This definition is equivalent to the following: a function f(X) is 
continuous at a point X of a set M if, given апу => 0, there exists 
7) = (2) such that, for all points Х € M lying in the sphere 

e, X) = X-FI] <n, (2.52) 
we have 


ГАХ) Д0) | < e. (2.527) 


A function that is continuous at every point of a set М is said to 
be continuous in М. 
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EXAMPLE 6. The function 


1 = 1 

iiye Г 7 э, 

Ji-ixi pink 2 
i=l 


is defined and continuous at every point of the sphere || Х|? = 1. 
A linear function f(X) (see $ 1, sec. 5) can be defined as a function 
continuous in Е, and satisfying the additive condition: 


ДА+) = f(x) v füG). 


Uniform continuity. A function КХ) = f(x, Xs, ..., хо), defined 
on a set Mc E,, is uniformly continuous there if, given any є > 0, 
there exists 7 > O such that, for any pair of points Xj, X, Є M for 
which 

о, Ху) = |Х,-Х, || < n, (2.53) 
we have 


LAG) А) = =. (2.537) 


The number 7 in (2.52) depends оп = and on the choice of the point 
Х, whereas in (2.53), defining the uniform continuity of a function, 
it depends only on є and not on the choice of the points X, 
and X}. 

Every function, uniformly continuous on М, is continuous on M. 
The converse is not generally true (for example, the function 
ATENTE ZI continuous inside the sphere || Y|| < 1, is uniformly 
continuous there). 

As in the one-dimensional case (see Chapter I, $ 3, sec. 11), we 
have 

THEOREM 5. А function f(X) = f(x, xo, ..., Xn) continuous on а 
bounded closed set U, is uniformly continuous there. 

Maximum and minimum. A function f(X), defined on a set М, is 
said to be bounded from above (below) on M if there exists a constant 
C such that, for any point X € M, 


ДХ) = С (К) = С). (2.54) 


A function is bounded іп M if it is bounded from above and below 
on М. 
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If f(x) is bounded from above (below) on M, a number C(c) exists 
which is the strict upper (lower) bound of the numbers f(X), i.e. of 
the values of the function f(X) at the points M: 


С = sup KX) Ё = inf AX) Е (2.55) 
хем ХЕМ 
If there exists in M a point X, at which 
AX) = С = sup ДХ), 
ХЕМ 
the upper bound С is called the maximum of f(X) оп М: 
C = fX) = ах ДХ). (2.56) 


eM 


X, is called the maximum point for f(X) оп M. 
Similarly, if there exists in M a point X, at which 


JO) = с, 
c= inf f(X), 
XEM 


twhere 


the lower bound с is called the minimum of f(X) оп M, while Х, is 
the minimum point for f(X) on M: 


с = ДХ) = min ДХ). (2.57) 
XEM 


We say in this case that ХХ) attains its maximum (minimum) on 
M at the point X, (X;). 

'THEOREM 6. A function continuous on a closed bounded set attains 
its maximum and minimum in the set. 

Jump functions. We often encounter in problems of mathematical 
physics the following generalization of the concept of jump to a 
function of n variables. Let О, be a domain in E,. We say that it 
is “inside” its boundary Г, while the domain О, = E,—(Qi-- I) is 
"outside" the boundary Г. We shall write А; and А, for the points 
of О; and О, respectively.T Let a function f (which may or may not 


t i and e are the first letters of “interior” and “exterior”. 
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be defined on Г) be given in Q,+Q,. Suppose that the limit of f(4,) 
[АЛ exists, when A, (4;) tends to the point А of the boundary Г; 
we shall write here: 


(а) = lim f(4,). 
If f(A) = 7,4), we say that the function has a Jump 


SA) —filA) 


on passing through the boundary Г at the point A from Q; to Q,. 

EXAMPLE 7. Let us take a bounded closed convex domain О; in 
Е, with a boundary Г (a smooth curve), and the domain О, = F,— 
—0;,—Г. Given an arbitrary point 4€ E, we define a number 
«(A) > 0, measuring the angle under which the curve Г 13 seen from A. 
(It is formed by the rays joining A to all the points of Г). 

For points А, € Qj, we have a(A,) = 2л; for points 4, Е О, we 
have 0 < a(A4,) = л, where a(A,) — wif A, tends to a point 4 c Г. 
We have (4) = л for points A of the boundary Г. 

For the function f(A) = о(4) at the point 4 є Г, we have f,(A) = 
=f) = п < f(A) = 2л; the jump /(4)—f(4) = л. 

Functions depending оп a parameter. Every function (x, xo, ..., X4; 
ti, tg, ..., tn) can be regarded as а family 


Uus РЕА „Од, Xe; EE Xm) = ф(х), хә, жеу Xm hs to, tty t4) 


of functions of m variables xj, xs, ..., хи, each of which is defined 
by a set of n values of another group of variables 11, t2,..., t, — called 
“parameters”. We shall confine ourselves to the case of a system 
Ux) = ф(х, t)) of functions of one variable x, depending on one 
parameter /; t takes any value from aset Т of the numerical axis Ej, 
while every function f(x) is defined for x of the set X € E, (the 
generalcase of n parameters and m variables is investigated similarly). 
Let 1, be a limit-point of Т. If, given any ¢ and x € X, the function 
Six) tends to f(x) as t + ty (t € T), we say that the functions f(x) аге 
convergent on the set X to the function f(x). Given any x є X and 
any number 7> 0, we can find a number e, depending on у and 
X, € = e(n, x), such that 


LAG) — 091 = 1 (2.58) 
for 0 = |t—t)| <e (t € T). 
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For example, let Т be the interval (0, œ), and X = [0, 1]; the 
family of functions {/,(x)} is convergent to f(x) on [0, 1] as 1 — 01 


sin tx 


(а) Ло) =——, Ло) = х; 
(Ы) Ло) = (1 хуи, fe» = e 
(с) Ло) = х Д) = { 0 for O<x<1, 


1 for x=. 


The convergence of { f,(x)} to f(x) on X is said to be uniform as 
i+ to (t € T) if, given any 7 > 0, there exists e = e(n), depending 
on 7, such that (2.58) is satisfied for all x € X when |t—t,| < = (Е по 
longer depends on the choice of x). In examples (a), (b), we have the 
case of uniform convergence, and of non-uniform in example (c). 

The following are properties of the uniform convergence of a 
family of functions {1(х)}: 

1°. If the family (f(x)) is uniformly convergent on X to f(x) as 
t > to (t € T), and (t,) is any sequence of T, convergent to to, the 
Sequence of functions ( 2.6} is uniformly convergent to f(x). 

2°. If all the functions f(x) are continuous on X, their uniform 
limit is a function f(x) continuous on Х. (See examples (a), (b). In 
example (c), the limit function is discontinuous, which points to the 
non-uniform convergence of (f(x)) to f(x).) 

3°. Let ф(х, t) be a function of two variables continuous іп the rectangle 
а х= ау, ==. On writing f(x) = ф(х, t) for t € [b, b), 
f(x) = ф(х, bj), we find that the functions f(x) are uniformly convergent 
to f(x) as t — b, 


4. Periodic functions of и variables. Manifolds of constancy 


Let E, (1 = k = n) be a linear manifold in E,, and f(X) a function 
defined in E,. We say that E, is a manifold of constancy for the func- 
tion ДХ) if, given any X c E, and any Y of E,, we have 


ДХ+Ү) = ДХ). (2.59) 


For example, in the case of the function f(x-- y) of two variables 
x and y, the straight line x — — y is a manifold of constancy. For, 
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if we add to the vector (х, y) any vector (хо, —хо) of this straight 
line, the function is unchanged. 
Let us bring in the basis in E, of elements Y, Yo, ..., Yp; Zi, Zz, ... 
... Zany Where Y, Y, ..., Y, form a basis in the manifold of 
constancy E,. Every element X Є E, can be written in the form 
(see (2.29)) 


X +7, 
nok 

Yek, Z= У 12, 
i=1 


where 
KX) = КУ+2) = KZ). 

The function ДХ) = f(Z) reduces to a function of n—k variables — the 

coordinates Z}, 25, ..., Z,_, of the vector Z. 

A period of a function of n variables. A period of a function f(X), 
defined on £,, is vector о (different from the zero 0) such that, for 
any X, 

f(X -- o) = КХ). (2.60) 


It follows from (2.60) that all the elements Y = 8 of a manifold 
of constancy of a function f are periods of f. A function f(X), having 
a period that does not belong to the manifold of constancy, is described 
as periodic. 

We shall confine ourselves to periodic functions that have no mani- 
folds on constancy. Notice that every periodic function has an infinite 
set of periods (in addition to c, every vector of the form ko, where 
k is any integer, is a period). 

THEOREM 7. If œ and œw, are periods of a function f(X), their sum 
0+ 0, is also a period. 

If 01, в, ..., Om are periods of f(X), any vector w of the form 


m 
о = У то, 
iei 
where п; are arbitrary integers, is also a period. 

The periods €, 0з, ..., 0,, form a system of fundamental periods 
of f(X) if all the periods of ДХ) are expressible as linear combinations 
with integral coefficients of these periods and are not expressible as 
such linear combinations of a smaller number of periods. 


64 MATHEMATICAL ANALYSIS 


EXAMPLE 8. Let us take ХХ) = Д, X) = sin x, cos x, on the 
plane Е,. It has a system of two fundamental periods, namely, the 
vectors c (27, 0) and о, (0, 2л). We could also take as fundamental 
periods о; and c = (2л, 2л) (in which case w, = «3—0). 

THEOREM 8. A continuous periodic function of n variables, having 
no manifold of constancy, has a fundamental system of periods con- 
sisting of not more than n periods. 

EXAMPLE 9. Let ©), 05, ... , @, be a system of linearly independent 
vectors in E,. Let us form the set А of all vectors (points) of the 
form 

л 
Y Ta'0j, 
i 
where the n; are integers. (Such a set is called a net of integers in E,,.) 
We shall write o(X, А) for the distance from the point X € E, to 
the nearest point of A; o(X, A) is a function of X. It has a system 
of fundamental periods consisting of the vectors @,, 05, ... , Фу. 

EXAMPLE 10. A continuous function of a complex variable 
f(x-r iy) = Р(х, y)+iQ(x, y) (not equal to a constant) cannot have 
more than two independent periods (Jacobi's theorem). 


5. Passage to the limit for linear envelopes 


Let a, а... , ар be linearly independent elements in E. We shall 
write L(a,, @»,...‚ ар) for their linear envelope. If Р bz, ...,5, 
is another basis in the p-dimensional manifold L(q,,...,a,), then 
Lb, b, ..., bp) = Lp (а, аһ..., ар). 

Let us consider а family of vectors /,, continuously dependent on 
а parameter а, such that, when a — 2, a, — (аз зод), the expression 
Clag — 4a,)/(%2—%) tends to a vector which we shall denote by di, /dx. 
We shall assume that /,,, and /,, are linearly independent whena, =. 
Having chosen another basis in L,(/,,, lap): 

lap a, 
Og hy 
we have 
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Assuming that the vectors /, and dl,/dx are linearly independent, 
we find that, as а ~ а, c, ~ а, then the plane Lalas lag) = 
=, (Ь,— 1, (25—2x3)) tends to the plane Lolla dl,/dz). 

Given similar conditions (assuming that the systems of vectors 
Lo lags ees 1а " where no two of the numbers а, a,...,%, are 
equal, and of the vectors /,, dl, /dx, .. . , 1,4, are linearly inde- 
pendent), we find that, as x; х (і = 1, 2, ..., p): 


d de-i 
LAE iy ig US OI (^ aes dort]. 


Given a family of functions f,(x), dependent on a parameter «, with 
the same conditions and with х, - «(i = 1, 2, . . ., p), we find that 
Lyfe ls fas es У. К) tends (о /,(/,(Х), Of (<) [9х ..., 


OP-1 f (x)/dx?-"). For example, as а; — æ (i = 1, 2,...), we have 


Ly (em, бах, ..., e*»7)  І.„(езх,хеах, ..., xP tee), 


1 1 1 
„(5 х-а `7 ex) 


L 1 1 1 
PY x=’? (x—ay' ``°' (хор ]’ 


L,(x™, WE wy xe) => Las, xin Xo, X 17-1 х), 
Ы(|х—|, |x-ay|) + Е ха, sign | x —«|). ] 


Let Аа be an n-dimensional, matrix, Aj, (i = 1, 2, ..., n) be its eigenvalues 
(simple юго »* 0), x,q the corresponding eigenvectors: A „хе = Ais Ха» 11x, l=. 
Suppose that & of the numbers Ais (21.2, ..., kan)tendas« + Oto the eigen- 
value A, of the matrix A,, while the eigenvectors x, (i = 1, 2,..., А) tend to 
the eigenvector x, of the matrix А,, corresponding to the eigenvalue A,. The linear 
envelopes L, (x Ааа... Xy ) now tendtothe linear envelope Ly (x1, Xg- X4) 
where x, with i > 1 are augmented eigenvectors of the matrix 4, : 4х; Ао - 
=x, (=2.3,..., К). 


6. Operators from E, into £,, 


Let О bea set in E, (which can coincide with E, itself); we associate 
with every element X(x}, xs, ..., x,) of О an element Ү(у, Yas ees уһ) = 
= ДХ) of Em. We say in this case that an operator f is given from E, 
into E,, Q being called the domain of definition of the operator. We 


66 MATHEMATICAL ANALYSIS 


can also say that we have a mapping f of the set О of E, into E, or 
that the operator f performs a mapping of the set О from the space E, 
into the space E,,. 


If 
Y = Op Ys vers т) X = (Xr Xo -s Xn) 
Y = ДХ), (2.61) 
Шеп 
yi = fX) = fixi Xs... ху), (2.62) 


where f, is a function of n variables defined in Q, formula (2.62) 
being the coordinate form of writing the operator f, and (2.61) the 
vector form. The functions f; (i2 1, 2, . . ., m) are called the components 
of the operator f, and we write 


S= Us fe fn 


Every set of m functions f,(x,, x... x,) (= 1,2, ..., m) 
of n variables defines an operator f from E, into E, where f = 
= (fis 5 tt o Jm) 

An ordinary function Их, x», . . ., Xn) is an operator from E, into 
E, (into the numerical axis). 

An operator f(X) is said to be continuous in О if 


Xn -z> XY 


п т > оо 
Х„ and Х belong to О) implies that 
ДХ) zm KX). 


The necessary and sufficient condition for the operator KX) = (fi(X), 
JAX), - - -> Л) to be continuous is that all the functions f(X) = fi, 
Xo... Xp) be continuous in О. 

For example, the functions 


Z = Jl-xi-xi-xi = V1- XIP, 
Z = Xy Xx+ Xs 

yield an operator from Е, (ху, ху, хз) into the plane £,(Z,, 25), defined 

in the three-dimensional sphere | Y||? < 1 and continuous there. 

Functions of a complex variable provide us with examples of operators 

from E; into E; (mapping of a plane into a plane). 
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The term vector function is occasionally used instead of operator 
from E, into Ep. An ordinary function of n variables (n> 1, т = 1) 
is called a scalar function of a vector variable; an operator from Е; 
into E, where n — 1, is called a vector function of a scalar variable or 
simply a vector function, and an operator from E, into E,, where 
n> 1, т> 1, is called a vector function of a vector variable. 

Let X = X(t) be a given vector function, where і runs over the 
numerical axis (or a segment of it), and let X be а point of E. The 
set of points of E,, of the form X(t) is called a curve or line in Е. 

Linear operators. A linear operator (mapping) from E,(x, ха»... Xn) 
into Е „(у Ya, «+ +» Ут) is an operator Y(X)satisfying the conditions: 

(1) YA, +X) = Ү(Х)+ У(Х); 

(2) the operator У(Х) is continuous. 

It follows from conditions (1) and (2) that a linear operator is 
homogeneous: 

Y(AX) = AY(X). 

THEOREM 9. A linear operator Y(X), where Y = (у, у, ..., Ym) 

X = (х, №... x), has the form: 

yi = GduXy-.dioXo + ... Бахь (= 1,..., п), (2.63) 
ie. every coordinate у(Х) of the operator Y(X) is a linear function 
of X = (Xy, х, ..., ху). 

Every linear operator Y(X) from E, into E,, is defined by a rectan- 
gular matrix 

А = а @=1,2,...‚т; j=1,2,..., п), | (2.64) 
У = AX. 

Conversely, every such matrix defines a linear operator from E, into 
E, (in accordance with (2.63)). When т = n, a linear operator from 
E, into E, is defined by a square matrix A = |а ШТ 

Formula (2.63) is the coordinate form of a linear operator (transfor- 
mation) from E, into Em- 


7. Iterative sequences 


Let 
{Xn} = (Xo Xy Xo $, Xn = (Хи, Xuan... Xna) (2.65) 
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be a sequence of vectors in E,, the corresponding k numerical sequ- 
ences being 
{хы} = {хо Tris хь...) @=12,..., К). (2.66) 
The vector sequence (2.65) (or system (2.66) of numerical sequences) 
is described as iterative if 
Xn =) QG-123..)| (2.61) 
where fis an operator from E, into Ep. If f = (Л, Jo . . ., Jh) equation 
(2.67) may be written in the coordinate form as 
Xni = Jn, 1 Хп-1,2› +++, Xn=1, Э) (2 = 1, 2,..., К). 
(2.68) 
On putting X, = (хо, Хо»... Хо), We can find successively from 
(2.67) or (2.68): 
Ху = (х, Nags oe ey Mra), Xa = (Хәр Xan, -e3 Mande s 


Relationship (2.68) is sometimes written as 


Xni = ДО», Хаз +++ Ха, i-p Хальь Xnoi iens sss Xn-i k) 
(2.69) 
(When finding the ith component of the nth vector X,, use is made 
of the components Xpy Xng . . +) Xn, +1 already found.) 
EXAMPLE 11. K. F. Gauss. considered a sequence of pairs of роѕі:іуе 
numbers {x,, Ви} (n = 0, 1, 2, ...) or of plane vectors, where a, 
Bo are given (xg = Во), and 


Spi + Pn- 
Xn ааа, Ba = spa. 


As n — œ, the sequences {x,} and {В„} tend to a common limit 


а = lima, = lim f, — the arithmetico-geometric mean of the num- 
т —> со no 


bers xs, Во: 
а = аж, Dy) = = ons |" . 
26 ЕЕ т 
ce ая Ф 
EXAMPLE 12. Let us take the sequence of ы sums 5, = 1+ 
+(x/1!)+...+(x"/n!) of the power series for e”. On writing х, = п, 
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Bn =(x"/n!) we have: (xo, Во, 50) = (0, 1, D). We get an iterative 
sequence (xn В, Sn) of the form (2.69): 


x 
Xn = Antl, В, = Вы: Sn = 51+ Ви. 


The formula provides a unified scheme for obtaining successively 
(En Ви» Sp) (ie. 5, also) for n= 1,2, 3, . . .. The unified passage from one 
term of an iterative sequence to the next term is very convenient for 
computation on programme-controlled machines. 

Iterative processes. We can generalize the concepts of § 2, sec. 6, 
to operators from E, into E,. 

Let f be a continuous operator from E, into E,: 


Y=f(X), Y= On №...) Y X= Oy Xo... Xn) 
or, in the coordinate form: 
yi = SMX, хә... Xn) G= 1, 2, ..., п). 
Let us investigate the equation 
X = f(X) (2.70) 
or, in the coordinate form, the system of equations 
Ж; fis hs oF ЖАБ (2.71) 
We form the iterative sequence of elements 
Хо, Жү, Жо» oy Xm el) Kma = (Emi Anp аэ, Хай)» 
where Хо(хол, Xoz -+ s Xon) is an arbitrary element of E,, 
Хы = SX mn) (m=0, 1, 2,...), (2.72) 
and in the coordinate form 
Керч IG nie ани) (= |, 2,..., м). (2.73) 


If the sequence X,,, is convergent to Х*, X* is a solution of equation 
(2.70). 


The solution X* is called а fixed point of the transformation Y= f(X). 
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8. The principle of contraction mappings 


We introduce a norm into the space E,, (see § 1, sec. 2). An operator 
(transformation) f from Е, into E, is said to be acontraction mapping 
if there is a constant q (0 < q < 1) such that, for any X, X, € Ew 


IQ) - Q0 s a1X:— XII. (2.74) 


The following theorem provides a condition for the existence of a 
fixed point of the transformation Y= f(X), i.e. of a solution of equa- 
tion (2.70), and at the same time, a condition for convergence of the 
iterative process (2.72). 

THEOREM 10. (the principle of contraction mappings). Jf Y = f(X) 
is a contraction mapping (i.e. condition (2.74) is satisfied with 4 = 1), 
then: 

(1) there exists a solution X = X* of equation (2.70), i.e. a fixed 
point X* of the transformation У = КХ); 

(2) this solution is unique; 

(3) whatever the initial approximation Ху, the iterative process (2.72) 
is convergent to the solution X*, 

Х*= lim X4. (2.75) 
т- оо 

(4) the sequence X,, is convergent to Х* as fast as the convergence of a 

geometric progression with ratio q, in fact, 


Пан, s E а. 2.76) 


We shall mention some sufficient conditions for an operator to be 
a contraction mapping under different norms. It is assumed that the 
functions A(X) = Л(хь Хх»... х) — the coordinates of the operator 
(X) — have continuous partial derivatives with respect to all the argu- 
ments. 

For condition (2.74) to be satisfied, (also the consequences of the 
theorem), it is sufficient that: 

(a) in the Euclidean metric, 


yy icr m EE =| sq <l; олт) 


1 gm Ox; 
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(b) in the metric may (see p. 97), 


Y д Ол Хә... Xn) 


Zq<1 © @=1,2,..., п). 
A às; 4 ( ) 
(2.77) 


Application to the solution of systems of linear algebraic equations. 
Let us take the system of linear algebraic equations 


n 
у; = У djX; + b; (2.78) 
J=1 
or, in the vector form, 
У = AX+B, (2.79) 
А = |141, В =, 6, ..., bn). (2.80) 


Given any initial vector Хо(хол» Xoz - - ., Хоп), We form a system of 
vectors Xo, Xi, Xs, ..-, X, 


ND CE 
Xm = (Хул Xm» sees Xmn)s (2.81) 

where 
Хт = АХ +B (т = 0, 1, 2, ...) (2.82) 


or, in the coordinate form, 
п 
Хт+1,+ = У аи ((=1,2,...‚ n). (2.83) 
j=l 
It follows from (2.77) and (2.77') that a sufficient condition for con- 


vergence of the vector sequence X,, as т — ee to the vector solution 
X*(xj, X3, .. X5) of system (2.79) or system (2.78) is that 


3 


n 
(а) Уа —4-41 
iz1j-1 
or 
ES n 
(b) Zee ed i21,2,..., m) 
= 
(q=maxq; і= 1, 2,..., п), 


the accuracy || X*— X, || of the nth approximation X, being defined 
by (2.76); in case (a) the norm is Euclidean, in case (b) it is Dy. 
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$3. Convex bodies in 7-dimensional space 


The theory of convex bodies in n-dimensional spaces was developed 
by G. Minkovskii; it has found applications in numerous problems of 
analysis, geometry and number theory, and more recently in new 
branches of applied mathematics: in the theory of games and in linear 
programming. This theory provided the basis for developing the the- 
ory of n-dimensional normed spaces, the infinite-dimensional generali- 
zation of which plays an important role in analysis. 


1. Fundamental definitions 


A convex set in space E, is one which contains, in addition to two 
points A and B of the set, every segment joining these points. 

Particular cases: a convex domain Q is a domain which is a convex 
set, a convex body Q is the convex domain Q together with its boundary 
Г. Points of the domain О are called interior, and points of Г boundary 
points of Q. 

On a straight line, an interval is a convex domain, and a segment a 
convex body; on a plane, the interior of a circle or triangle is a convex 
domain and the circle and triangle (including their boundaries) are 
convex bodies; in three-dimensional space, the interior of a cylinder, 
Sphere, cube are convex domains, and the cylinder, sphere and cube 
(including their boundaries) are convex bodies, the sphere and cube 
being bounded convex solids, and the cylinder an infinite convex solid. 

А closed convex set, lying in a k-dimensional plane and not lying 
in any (k— 1)-dimensional plane, is called a k-dimensional convex 
body (0 = К = n). А point will be described as a zero-dimensional 
convex body. (The empty set is also regarded as convex.) 

А convex body (set) may be bounded or unbounded (cf. the above 
examples). We can quote as an example of an unbounded convex body 
a half-space in E,, i.e. the set of points X satisfying the inequality 
(fX = C), where f is a linear functional in E,, and C a constant; 
the whole of the space E, and any hyperplane in it are examples of 
unbounded convex sets. 

The intersection of convex sets in E, is a convex set, the intersection 
of convex bodies іп E, is a convex k-dimensional body (k = n). 


N-DIMENSIONAL SPACES AND FUNCTIONS DEFINED THERE 73 


A convex polyhedron is a closed convex body — the intersection of 
a finite number of half-spaces. 

The convex envelope of a set M in E, is the set О of points X € E, 
expressible in the form 


i 
X= Y AX, (2.84) 
i21 


where l is any integer, / = n, X, are arbitrary points of М, A, are arbi- 
trary non-negative numbers satisfying the condition 


EXAMPLE 13. The convex envelope of a pair of points А and В is 
the segment joining them; the convex envelope of three points not 
lying on a straight line is a triangle; the convex envelope of four points, 
not on the same plane, is a tetrahedron with vertices at these points. 

The convex envelope of a set M is the intersection of all convex sets 
containing M, or the least convex set that contains M. Every bounded 
convex polyhedron is the convex envelope of a finite number of 
points — the vertices of the polyhedron. 

Limit points. A point 4 is a limit point of a convex body Q if A 
is not an interior point of any segment belonging to Q. 

Every limit point of Q is a boundary point of Q; but not every bound- 
ary point isa limit point. For example, only the vertices of a polyhe- 
dron (polygon) are its limit points. In the case of a circle and sphere, 
all the boundary points are limit points. In future, a convex body will 
be taken to mean a bounded convex body. 

А convex body О is the convex envelope of its limit points. 


2. Convex functions 


A function ДХ) = f(x,, xs, .. ., x,), defined in E, (or ona convex 
set О of E,), is described as convex if, givenany X and Y of E, (of О), 
we have 


C) suco som (2.88) 


(and concave, if the reverse inequality is satisfied). 
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A convex function also satisfies the more general inequality: 


ЛаЪ-ох+и = 0-2f00 1) (2.85' 
for any t € [0, 1]. 
(See Chapter I, $ 3, sec. 17, for convex functions of one variable.) 
If f(X) is a convex function, ey is a lower bound in E, (in Q), the 
set of points of E, (of Q), satisfying the inequality 
ДХ) = с, 


with any c = су, is а convex body (set). 


EXAMPLE 14. On the plane E, (ху, хз), the functions 
fo x) = С [P+ | x P7 
with p = 1 are convex functions. Азр- =, f,(x1, хг) tends to the function f. (xi, хо) = 
= max(|x,|, |x31) (see Fig. 2). The sketch illustrates the curves f(x, x;) = 1 


for different p. They all pass through the points А, (1, 0), 4, (0, 1), A, (—1, 0), 
A, (0, —1). 


The curve f. (x;, X2) = 1 is the boundary of the square with vertices A), Az, 
Аз, Ay. 

The curves Л, = 1, where J] < р < ~, lie between these two curves. 

The curve f; (xi, хз) = 1 is the circle of radius 1. 
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The figures f, = 1, bounded by these curves, are convex. When p<1, such 
figures аге no longer convex. For instance, when p = 2/3, we get a figure bounded 
by an astroid. 


3. Convex bodies and the norm of a vector 


Let О be a convex body in E,, having 8 as an interior point. Every 
point X of E, can be written (uniquely, when X = 0) as X = AX, 
where A> 0, X, is a point of the boundary of О. If X lies outside О, 
then 4> 1; if X lies inside О, А = 1;if X lies on the boundary of О, 
А = 1. The point 0 can be written as 0.X, (i.e. A = 0 for the point 0). 

We now define a function фо(Х) in Е, as follows: at the point 
X = 4X), 

PAX) = 5; 


P(X) is greater than, equal to, or less than 1, depending on whether 
X is outside, inside, or on the boundary of О respectively, 


P8) = 0. 


фо(Х) is a convex function. The body Q is the set of points of E, for 
which фо(Х) = 1, while the boundary of О is defined by the equation 
P(X) = 1. 

фоб) has the following properties: 

(1) Фо) = 0, where фу = 0 only when X = 0; 

(2) Whená = 0, фо(АХ) = Ag g (X) implying a positive homogeneous 
function); 


(3) 9o (X - У) = ро (Х)+ Фо (У). 

If Q is a central symmetric convex body with centre at 6 (ie. X€ Q 
implies — X € Q), we have the additional property: 

PAX) = || Фо(Х) for 1 < 0. 

Property (2) becomes the stronger property: 

(2) Фо(АХ) = |Aleg(X) 
for any real 4. If ф is a given function satisfying conditions (1)-(3), 
the set О defined by po (X) = 1 isa convex body, while it is a centrally 


symmetric convex body with centre at 0 when condition (2^) is 
satisfied. 
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The Euclidean norm || X || of the vector Х Є E, satisfies conditions 
(1), Q^, (3). We can generalize the concept of norm of a vector in 
n-dimensional space: the norm can be taken as any function g(X) 
that satisfies conditions (1), (2), (3). We shall write E, „ for such a 
space. 

ЕХ = p(X), conditions (1) - (3) can be rewritten as: 


(DILXi[ = 0, and | Х| = 0 only when X = 0; 
(2) When A> 0, we have АХ = АХ; 
(3) ПХ+У = ll Xl YI (the triangle inequality). 


When ф is even, condition (2) is replaced by the stronger one: 
(27) АХ = [А НЕХ (for any 2). 


Spaces E,, in which a norm is introduced, satisfying the above 
conditions, are said to be normed. For instance, Euclidean spaces are 
normed (see $ 1, sec. 7). 


4. Support hyperplanes 


n 
Let us take the linear form fX = X ix, ш E, the hyperplane 


іт] 
(fX = С) апі the half-space (fX = C). We call (£X = С) a hyperplane 
of support for the convex Бойу О if О lies wholly in the half-space 
(fX = С) and the hyperplane has points in common with the boundary 
of О. 

EXAMPLE 15. In the two-dimensional case, the hyperplanes of support 
reduce to lines of support. In the case of a circle, the lines of support 
are the same as the tangents. In the case of a triangle, the lines of 
support are the three lines along which its sides lie, together 
with all the straight lines passing through its vertices and lying in 
its exterior angles. In three-dimensional space, hyperplanes of sup- 
port become planes of support; for a sphere, the planes of support 
are its tangent planes, and for a cube, its boundary planes and the 
other planes that pass through the intersection of two sides, or 
merely through a vertex and do not cut the interior of the cube. 

Let the equation of the hyperplane of support be 


fX-C. (2.86) 
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THEOREM 11. The number С on the right-hand side of (2.86) is defined 
by the equation 


С = max fX. (2.87) 
хє9 


The equation оў the hyperplane of support therefore has the form 


fX = max fX. (2.88) 
XEQ 
THEOREM 12. The linear function fX attains its maximum C on Q 
at a limit point of О, i.e. the intersection of (fX = С) and О contains 
a limit point of Q. 
Coro ary. Every hyperplane of support of a body О passes through 
one of its limit points (in particular, each hyperplane of support of a 
polygon passes through one of its vertices). 


5. Support functions and conjugate spaces 


Let the norm || Х|| = y,(X) be introduced into space Е, and let 
Q be the closed unit sphere: О = (|| X|| = 1); О is a convex body in Ep. 
І 
n 
i 
is a linear form in E, = Epp, the corresponding hyperplane of support 
of Q is given by the equation 
ІХ = С(= max IX). (2.89) 
I Xi zai 
Every linear form IX is a vector / with components h, 5, ..., lp. The 
set of such forms makes up an n-dimensional linear system L,. А norm 
can be introduced into L,, i.e. we can put 
Hit = (= max IX. (2.90) 
ПАП zai 
This norm satisfies, along with the norm || X ||, conditions (1), (2), 
(3) (see sec. 3) or (1), (25, (3). 
We have: 
UX] = IIL. (2.91) 
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This inequality is a generalization of inequality (2.7) for the Euclidean 
metric, Equation (2.89) can be written as 


IX = ША. (2.92) 
Conjugate Spaces. The space L, = Epy thus introduced, of linear 


forms in Epp, is described as conjugate to the initial space £,,,. 
The following notation is used: 


Eny EM. (2.93) 
The conjugate to a Euclidean space is also Euclidean. 


THEOREM 13 (Minkovskii). If the space Epy is regarded as the initial 
space, its conjugate becomes Enp 


ES = Eny (2.94) 


(the conjugate to the conjugate space is the initial space). 

The reciprocal property whereby spaces E,, and E,, are conjug- 
ates of each other is known as reflexivity. Functions p(X) and y(J) 
are said to be reciprocal; they are connected by the relationships 

max ЇХ = (D, max IY = g(X). (2.95) 
e(x)zi ps1 
Similarly, the convex bodies О and Q*, defined by the inequalities 
pX = 1, pl = 1, are also said to be reciprocal. (Minkovskii's theorem 
is no longer in general true for infinite spaces.) 

EXAMPLE 16. Let I, „(р = 1) be an n-dimensional space with the 

norm 


ШЕ (È | ry”. 


When p> 1, we have Га р = 1, p where (1/p)--(1/4) = 1. 
When p = 2, (the case of a Euclidean norm) we have g = 2 (the 
n-dimensional Euclidean space /, is self-conjugate: l, 3 = ln, o). 
EXAMPLE 17. Let /, , be an n-dimensional space with the norm 


n 
IX = Y ixl, 
iSl 


and т„ an n-dimensional space with the norm 


ПУ = max Gy 122... р: 
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we have: 
* * 
I, 1 = М, My = inir 


Every linear function YX in E,, can be regarded as the scalar 
product of a vector X of E,, and Y of E, 


y* 


6. Fundamental theorems on support hyperplanes 


THEOREM 14. Let О be a convex body in n-dimensional space E,. 
A hyperplane of support of Q can be drawn through every point of 
the boundary of Q. 

The following is a generalization of this theorem: 

THEOREM 15. Let Ё. (К = n) be а k-dimensional plane drawn through 
an interior point A of the n-dimensional convex body of E,. It cuts from 
О a k-dimensional convex body Q,. Let Ly, be the (k—1)-dimensional 
plane in L, which is a support plane for Q,. An (n—1)-dimensional 
hyperplane L,,_, can be drawn in E, which is a support hyperplane for 
О and contains Ly; 

Let l,XY be a linear form in the k-dimensional manifold E, C Ew 
(13 k < n). The linear form /,X in the whole space E, is called an 
extension of the form /, if, for X c E,, 


LX = hx. 
The form /, in L, has the norm 


ПА Ни, = _ max АХ. 
I Xi. Xe E, 


The form 7, in E, has the norm 


Wall = ПА ЦЕ, = max LX. 
HXI 
It follows from this that || 1, || = 1 12, i.e. when a linear form is 
extended, its norm can only increase. 

THEOREM 16. Any linear form 1, X, defined in a k-dimensional manifold 
L, of En 1 = k < n, can be extended to the whole of space E, without 
changing the norm. 

This theorem can be extended to infinite spaces (the Hahn-Banach 
Theorem). 
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7. The connection between reciprocal convex bodies 


Let О and Q* be unit spheres in E, and E; . A duality (not one-to- 
one) can be established between the points of their boundaries. 
Equation (2.89) of a plane of support of Q in E, can be written as 


п 
Ух = > Yoi = 1. 
i£ 


In this case (see (2.92)), || Y,||* = 1. Formula (2.92) becomes 
YX = |*= 1. (2.96) 


We associate with every point X, of Ep, for which || Xo || = 1 (i.e. 
points of the boundary of О), all the planes of support of О passing 
through it, these planes having equations of the form (2.96). We have: 


YoXo=1, ПХ = ПУ = 1. (2.97) 


Formula (2.97) yields an expression for the У, €*,, which correspond 
to a given X, €E,; it bas symmetry with respect to Ху and Y, 
which points to the reciprocity of this mapping. 
Theorem 14 shows that every X, of the boundary of О (||X,||= 1) 
has at least one associated Y, of the boundary of Q* (||У||* = 1). 
EXAMPLE 18. On the plane m,, the sphere 


(IL XI] = max Cb 1521) = 1) 


is the square = B,B,B,B,; on the plane la, the sphere (ПУ|| = 
= |у,|+|у»| = 1) is the square Q* = А, А„А„А,. Corresponding to the 

point X, (1, 1) 2 B, ofthe boundary of the square О, we have the 
Yoi, yz) for which 


l2 Ү,Х = yat дж = +»; ПР = [|+ [55| L 
ie. у= |i] = 0, ya lys] = 0. 


These points thus fill the side А, А, of the square Q*. 

The side B,B, of the square Q lies on the support line X, — 1, ie. 
1.X, 40. X, = 1. The corresponding point is У, (1, 0) — the vertex A, 
of the square Q*. The remaining sides of Q* correspond to the remain- 
ing vertices of Q, the vertices of Q* to the sides of Q and vice versa. 

In three-dimensional space the convex bodies Q and Q* can only be 
convex polyhedra simultaneously, the vertices of Q being associated 
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with the faces of Q*, the ribs of Q with the ribs of Q*, the faces of 
О with the vertices of Q* and vice versa. Such polyhedra are said 
to be reciprocal, For instance, if Q is a cube, Q* is an octahedron (and 
vice versa); if О is a dodecahedron, Q* is an icosahedron (and vice 
versa). 

In the n-dimensional case О and Q* can only be polyhedra simul- 
taneously, the k-dimensional faces of Q (0 Sk = n— 1) being associat- 
ed with the (n— k— 1)-dimensional faces of Q*. 


8. The cone. The tangent cone 


A сопе К in E, with vertex at X, € E,is a set of points of £, differ- 
ent from the whole of E,, and such that, if X belongs to K, the entire 
ray (tX), 0 = t< «o, belongs to К. We shall assume without any 
proviso that the cone K is a convex body. A cone, together with two 


Fic. 3. Е. 4. 


of its rays forming an acute angle, contains the entire angle. Cones 
on a plane are angles not exceeding л. In three-dimensional space 
examples of cones are provided by dihedral angles not exceeding =, 
ordinary circular cones or regular pyramids, continued indefinitely, 
etc. 

Let Ху be a point of the boundary of a convex body О in Е; let 
us write K(X,) for the least cone with vertex at Хо that contains О; 
this cone consists of all the rays joining Хо with points of Q and all 
the limiting rays. We shall call the boundary of this cone the tangent 
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cone hypersurface to О at the point Ху; two cases are possible: 

(1) The cone K(X) coincides with the entire half-space, its 
boundary is the unique hyperplane of support at X, to О, which 
“touches” О at the point Xp. 

(2) The cone K(X,) is a regular part of the half-space; an infinite set 
of hyperplanes of support of О passes through the point X,. Such а 
point will be called a point of sharpening. 

EXAMPLE 19. On a plane, thecone K(X,) becomes an angle bounding 
two tangents to О at the point X, = 0 (the rays OA, OB in Fig. 3); 
if this angle is equal to л, both rays form a unique support line (the 
line A'B' in Fig. 4), tangential to the boundary of Q at the point О. 
If the angle is less than л, the point О is a point of sharpening, and 
an infinite set of support lines pass through O. 

EXAMPLE 20. Let О be a convex polyhedron in E;. If the point X, 
lies inside a face, K(X) is the half-space bounded by the plane of the 
face, which is the unique support plane of О at Xo. If X, lies inside 
a rib AB, K(X,) is a dihedral angle less than л, formed by the planes 
of the faces that intersect in АВ; there is an infinite set of support 
planes to Q at Xp, all of which pass through the rib AB. If X, is a vertex 
of О, K(X,)isa polyhedral angle with vertex at Хе, bounded by the 
planes of the faces that meet in Жү; points of the ribs, and all the more 
the vertices of Q, are points of sharpening. 


9. Helly's theorem 


An interesting theorem on the intersection of convex bodies must 
be mentioned. 

THEOREM 17. Let {О} be an arbitrary set of convex bodies given in 
Ep at least one of which is bounded. If any п-- 1 of them have a common 
point, there is a point common to all the bodies of (Q). 

For instance, if an arbitrary set of segments, such that any pair 
has а common point, is given on a straight line, there is a point common 
to all the segments. 
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10. Linear operations on sets 


DEFINITION. Let А and B be any sets of E,. The vector sum A+B of 
these sets is defined as the set ( X) of points of E, expressible in the form 
X = X,+ X, where X, € A, Х ЄВ. 

EXAMPLE 21. If А is an arbitrary set, a a point (vector), then A +a is 
the set obtained by parallel displacement of the set А along the vec- 
tor a. ` 

EXAMPLE 22. If A is the x-axis, В the y-axis, 4 + B is the entire plane. 

EXAMPLE 23. If A in E, is an n-dimensional closed sphere of radius 
о with centre at 6, A+B is a “layer” of thickness o round B, i.e. the 
set of points of E, at a distance less than or equal to o from B. 

THEOREM 18. The vector sum of convex sets (bodies) is a convex 
set (body). 

DEFINITION. [fA is a number, А а set in E,, ЛА is the set of all points 
of the form AX, where X € A. 

A similitude transformation of the set A with transformation coeffi- 
cient 4 > 015 a transformation of the set A into the set AA. А symmet- 
ric mapping of A with respect to the centre 9 is a transformation of 
A into — A. 

When A = 0 the set AA consists of the single point б. 

If A is a convex set (body), AA is a convex set (body). 

n 


If A; (i = 1, 2, .. ., п) are convex sets (bodies), У 4,4, is a convex 
ici 

set (body) for any system of non-negative numbers А, 4, ..., An 
Let T, (1 = Cj) and T; (| = С.) be two parallel hyperplanes of support 
of the convex bodies О, and Q,, while (/, = Cj), (А = C,) are the corres- 
ponding half-spaces containing О, and Q, respectively; 1;, fp are arbit- 
rary positive numbers. Now, 4,7,-- 57 is a hyperplane of support 
parallel to them (/ 44 C, 4- С») of the body О = f,0;-- 50», lying 
in the half-space (/ = 4C, +ЬС,), 

THEOREM 19 (Brunno-Minkovskii). Let A, and A, be convex bodies 
in E,, and A, = tAy-(1—2)4,0 = t S1, a “linear system" of convex 
bodies; the n-dimensional volumes J, of the bodies Ag, A, and all the 
A, are connected by the Brunno-Minkovskii inequality 


УЛА) = 0 — DN AG) +N Tal. (2.98) 
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The case of equality occurs if and only if Ay and A, are homothetic convex 
bodies, i.e. one is obtained from the other by a similitude transformation 
and parallel displacement (A, = tAy+b, т = 0, b is a vector). 

Inequality (2.98) was proved by Brunno (in 1887); the case of 
equality was proved by G. Minkovskii (in 1891). 

Inequality (2.98) implies that HANE] is a concave function for any 
t in [0,1]. 

The theorem still holds for non-convex bodies, and in general for any sets, 


if J,(A) is understood as the exterior n-dimensional measure of the set A or the 
measure when it is measurable (see ref. 7). 


The Brunno-Minkovskii theorem is employed in proving the iso- 
perimetric and numerous other geometric properties of convex bodies. 


CHAPTER Ш 


SERIES 


Introduction 


Infinite sequences and their limits have been discussed in Chap- 
ter 1. Infinite series, or simply series, are closely connected with 
sequences, e.g. 


аү+@+...+а,+...= у ay (3.1) 


is “the sum of an infinite number of terms”. 

Series are commonly employed in the most widely spread branches 
of mathematical analysis and in the solution of applied problems, 
since they represent one of the most universal and effective means 
both of investigation and computation. 


Examples of series (infinite geometrical progressions) were known to the 
mathematicians of antiquity. In the process of developing the analysis of infinitesi- 
mals, series made their appearance, with the aid of which the values of various 
functions ‘could be computed: Mercator's series for the logarithm, Newton’s 
series for sin x, cos x, arc sin x, arc cos х, (14-х)®, etc. Series were widely used by 
Euler for representing functions in various works; in addition to power series, 
trigonometric series were employed by Euler. He also made use of divergent 
series, and seems to have been the first to be concerned with improving the converg- 
ence of series. The vast amount of factual material on series that had accumulated 
by the beginning of the nineteenth century posed to scientists the problem of 
finding a strict basis for the theory of series. The investigations of Abel, Gauss, 
Cauchy and others in this direction played an important part in laying the foundat- 
ions of mathematical analysis as a whole. 


The present chapter is devoted to the basic theory and practice 
of evaluating series. Numerical series are considered in § 1, functional 
in § 2, and the various methods of computing them in § 3. (See 
Chapter IV for vector series.) 
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1. Basic concepts 


DEFINITION: A series is defined as in (3.1), composed 
terms of an infinite sequence (a,) (n = 1, 2, 3, ...). For 
series there is a corresponding sequence {s,} (и = 1, 2, 3, 
partial sums, where 


n 
=а, Sy = Atay, ..., $— Y dy ls 


EXAMPLE 1. Given the series 


11 1 > 
1+5 +9+57+ em У аһ, 
we have 
4 | 03 1 
s = 1, =, и % = lx 9:16 dung 


of the 
every 


...) of 


(3.2) 


The following two cases are possible when considering the sequence 


of partial sums. 
Case 1. The sequence {5„} has a definite finite limit 


S= lim s. 
no 


This limit is called the sum of series (3.1) and is written as 


In Example 1, 
E 1\%®-1 3 
aros (3) =з: 


Case 2. The sequence {s,} has no finite limit. 
EXAMPLE 2. 


142434 ...4и+... = уоп; 
nel 
s,= 1, s53 os s ЛЛ, 5| 


As n — oo, the partial sum s, ~ oo. 


(3.3) 
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EXAMPLE 3. 
1-1+1—1+...= y et 
n=1 
Q when n is even 
$21, $420, 5=1,....,5,= , 
t J : s 1 when n is odd. 
EXAMPLE 4. 
1—-2+4—8+...= У (2071; 
n=l 
1—-(—-2y 
$21, $2-—l, 523, и=-5,..., s 2i. 


In Case 1 the series is said to be convergent, whereas it is divergent 
in Case 2 (Examples 2, 3, 4). 

Example 2 illustrates an important particular case of a divergent 
series, when s, + оо (or s, +— œ); Example 3 illustrates the case 
when s, oscillates while remaining bounded, and Example 4 the case 
when 5, oscillates but is unbounded. 

We shall only discuss convergent series in this section. In the case 
of a convergent series (3.1), the sum S can be written as 


S = 5+ Ra (3.4) 
where 
Rn = anyit angat = У аһ. (3.5) 
hencl 
is called the remainder or remainder term of the series. 

Evaluation (or summation) of a series implies finding its sum S. 

We must therefore verify the convergence of a series before finding 
its sum. 

Strict summation (some methods of which will be given below) 
is only possible for a narrow class of series. For the majority, the 
sum is found approximately. In approximate summations, the sum 
S is replaced by the partial sum 5,. 

It follows from the definition of the sum of a convergent series 
that 

lim R, = lim (S—s,) = 0. (3.6) 
n- оо 


п оо 
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This indicates that, given a sufficiently large п, the absolute value 
of the remainder term R, can be made as small as desired. 

To ensure the required accuracy when replacing S by s,,, it becomes 
necessary to estimate the difference 


S—s, = Ry, 
i.e. the remainder term. 

In addition, practical convenience in computations requires that 
the number п of terms of the partial sum s,, required for achieving 
the necessary accuracy, be not too large. Reasonably accurate summa- 
tion of certain series would require taking thousands, or even tens 
of thousands, of terms. Such series are said to be slowly convergent. 

EXAMPLE 5. To compute the sum of the series 


Тт | = 1 
1-=+ +... = У (Di 
d n=l n 


2°3 4 
to an accuracy of 0-001, the summation of a thousand terms is needed. 
The question thus arises of improving the convergence of a series, 
i.e. transforming it in such a way that summation of the transformed 
series with the same accuracy requires a smaller number of terms 
in the partial sum s,. The fundamental questions for the summation 
of series are therefore: convergence, estimation of the remainder 
term, improvement of the convergence. 


2. Some convergence tests for series 


Cauchy’s test for the convergence of a sequence (3.2) takes the 
following form as applied to series. 

Caucuy’s Test. The necessary and sufficient condition for converg- 
ence of the series (3.1) is that, given any => 0, there exists an n, such 
that у 

[аһы +4... Нат! < E 


for ай п> п, and any integer т. 
An important corollary follows from this test with m = 1. 
If series (3.1) is convergent, its general term a, tends to zero as п 


increases: 
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This condition is necessary but not sufficient for convergence. 
EXAMPLE 6. The harmonic series 
l 1 = 1 
1+—+—=+...= — 
Е 2 : 
is divergent, although a, = 1/n +0 as n + c». 

Cauchy’s test is the most general necessary and sufficient criterion 
for the convergence or divergence of a series. 

Direct application of it is difficult, however. The theory of series 
includes a whole range of sufficient tests for convergence and diverg-. 
ence of varying degrees of generality, and widely employed. Histor- 
ically, the first of these is 

D'ALEMBERT'S TEST. Jf the limit 

lim al д 
п —- оо | On | 
exists for series (3.1), the series is convergent when q<1 and divergent 
а > 1. (The test is inconclusive when q = 1). 
A more general test is 
Tue CAUCHY-HADAMARD Test. We write 
а= lim Ма, |. 
п со 
Series (3.1) is now convergent when 4—1 and divergent when q>1. 
(The test is inconclusive when q = 1.) 
THE PRINCIPLE OF MAJORANT SERIES. The series 


bytht...= УЬ, (3.7) 


with non-negative terms 5, is said to be majorant for series (3.1) if, 
given any n, 
lanl = bn 

as from some n = М. 

The convergence of series (3.7) implies the convergence of series 
(3.1). 

Numerous convergence tests are based оп the principle of majorant 
series, including in particular the d'Alembert and Cauchy-Hadamard 
tests. 
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§ 1. Numerical series 


1. Alternating series and series of constant sign 


If all the terms of a series are of the same sign, the series is said 
to be of constant sign. Such series include those, all the terms of 
which are positive (positive series), and those, all the terms of which 
are negative (negative series), 

If all the terms of a series are not of the same sign, the series is 
described as alternating. When there is a finite number of terms of 
the same sign, they can be neglected when investigating the converg- 
ence and attention paid only to the remaining series of constant 
sign. The theory of series with an infinite number of positive and 
negative terms has certain differences in principle from the theory 
of series of constant sign. 

The following is a particular case of the principle of majorant 
series. 

THEOREM 1. The series 


аа +... ++... = Уа, (3.8) 
with terms of arbitrary sign is convergent if the series 
lal Та |+... lauda... У lanl (3.8%) 
n= 


formed from the absolute values of the terms of series (3.8), is convergent. 

In this case series (3.8) is described as absolutely convergent. All 
series of constant sign are absolutely convergent. 

Cases are possible when series (3.8) is convergent, and series (3.8*) 
divergent. Series (3.8) is then described as non-absolutely, or condi- 
tionally convergent. 

EXAMPLE7. The series 

11 = (— 1)"-1 
ae Maar ace ... = уоп 
is convergent and its sum is S = In 2. 

On the other hand, the series of the absolute values of the terms 

is the divergent harmonic series. 
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2. Properties of convergent series. The associative property 


If the terms of the convergent series 


а+а+...+а,+...= У а 


are grouped in any manner, without changing their order: 


Gi via Pda Guar o Hig ааа tong es 
<> Un ла +++ T np ++.) 


where {n,} is a partial increasing sequence of numbers of the natural 
series, the series of the sums of the terms of these groups 


(1+... an) nei ie аа) +... 


is always convergent and has the same sum as the initial series. This 
property can be utilized for improving the convergence of series. 
The rearrangement property of absolutely convergent series. 1f the 


series > a, is absolutely convergent, the series obtained from it 
nel 

by any rearrangement (commutation) of the terms is also convergent 

and has the same sum as the initial series. E 

Non-absolutely convergent series do not have the commutative 
property. We have, furthermore, 

THEOREM 2 (Riemann). The terms of a non-absolutely convergent 
series can. be rearranged in such а way that the transformed series 
has a sum equal to any previously assigned number, or becomes di- 
vergent. 


3. General tests for the convergence of series of positive terms 


If we want to determine the convergence of the series with positive 
terms 


Y ap (3.9) 
к=1 
we choose at discretion another series with positive terms 


È br (3.10) 


kel 
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such that its convergence and sum are already known to us. 
We introduce the notation: 


Rn = S a (3.11) 
kam 


R,, is the remainder term of the series, which is equal to a finite posi- 
tive number if series (3.9) is convergent, and to o, if series (3.9) 
is divergent; 

b 

AM =—*, (3.12) 

акы 
where / is a parameter taking integral values such that m+! = 0, 
m is a fixed positive integer; 


lim А0) = А0, (3.13) 
h= o = 
jm АК) = AD. (3.14) 
Let 
im bp = Bw 319 
fm Ў = Ba: (3.16) 


in the case when the lower and upper limits coincide, i.e. when the 
limit exists, we introduce the notation: 


um AMD) = AD, 3.17) 


lim Y br=Bm (3.18) 


neo hem 


We have the following sufficient tests for convergence of series 
(3.9). 

Test 1. If A) > 0 and B,, = + <, series (3.9) is convergent, whereas 
if -œ <A) = 0 and B, = — œ, the series is divergent. 

Test YI. If AQ) <Oand B. — оо, the series is convergent, whereas 
if 0 = АД) = + = and В, = + s, the series is divergent. 
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Test Ш. If A(D) > 0 апа Ви = + œ ог A(D) «0 andB,,> — œ, the 
series is convergent; if0 = A(!) < + and В, = + оог е < A(N) = 0 
and Ви = — «e, the series is divergent. 

By a suitable choice of auxiliary series (3.10), we can obtain 
as particular cases from Tests I, П and IH either new or already 
familiar sufficient tests for the convergence of tests with positive terms 
(see sec. 5). These tests include, in particular, the familiar necessary 
condition for convergence which says that, if series (3.9) is convergent, 

lim a, = 0. 
n—=> оо 


4. Remainder term estimates corresponding to the various 
convergence tests 


When one of the convergence Tests I, II, III is satisfied for series 
(3.9), a corresponding estimate of the remainder term can be given. 
(1) For Test I: 


Вт Вт 
“at А = Ан “зар А A 
к= т һ=т 
where т is such that all the A,(/)>0; / is an integral parameter, 
satisfying the condition т-Е1 = 0. 

(2) For Test II: 


Bm B 
"inf A = Rm = “шр. АШУ? (3.20) 
k=m k=m 
where m is such that all the 4,(/) < 0 and m+/= 0. 

(3) For Test ЛІ, if A()>0, inequalities (3.19) hold, while (3.20) 
hold if 4(0 = 0. 

For Test ПІ, it becomes convenient to utilize the following par- 
ticular cases of (3.19) and (3.20): 

(a) When A(/) > 0 and the sequence {A,(/)} is monotonically in- 
creasing for К = т, we have 


Bm Вт 
"AQ) = Rma = AV . (3.21) 
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(b) When A(/)<0 and the sequence (4,(D) is monotonically 
decreasing for k = т, we have 
Вт ВА 
Zn = Rma = AW . (3.22) 
(c) When A()<0 and the sequence {A,()} is monotonically 
increasing for k = m, (3.21) holds. 
(d) When 4(7) > 0 and sequence (4,(7)) is monotonically decreasing 
for k z m, (3.22) holds. 
EXAMPLE 8. Let us estimate the remainder term of the series 
sd 
On putting, say, b, = z, ,—z,, Where 2, = —1/2m?, we have, 
provided that m > 1 and / = 0: 


Qm Dm» 
Aml) = 2m(m-1f › 
MO me 2d 
АП) = dim = B4- Bm @ы—2м) = 5 


It is easily verified that the sequence (4,(0)) (т = 1, 2, 3, ...) 
is monotonically increasing, while the sequence (4,,(1)) (т = 1, 2, 


3, ....) is monotonically decreasing. 
Consequently, when / = 0 and m = 1, we have by (3.21): 
1 {т-- 1)? 


Эре Кт < Osilws 
while with / = 1, by (3.22), 
A TUNES 
(mt 1) (m4 D +17 20 ` 
We obtain from the last two inequalities, in choosing the greatest 
lower and least upper values, 
1 (т+1 
(2m — 1)т < Rm (2m -- 1)т$` 
This example shows that, given the same choice of sequence (b,) and 
different values of the index /, estimates can be obtained that do not 
overlap each other. 
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5. Special tests for the convergence of series of positive terms. 
Estimates of the remainder term 


Numerous familiar classical tests for the convergence of series 
with positive terms follow from the general convergence Tests I, II 
and III (ѕес. 3). We shall give here certain of these and the corres- 
ponding remainder term estimates (see ref. 9). 

1°. THE GENERALIZED D’ALEMBERT TEST. The following two tests 
can be regarded as a generalization of the d’Alembert test mentioned 
above. : 

Test А. If, for a fixed 1, 

AQ = lim “тї a 9, @.23) 


n—>co бл 
оо 


the series У a, is convergent, whereas the series is divergent if 
nel 


А = lim 292—9. 9, (3.24) 


noe н 


Test В. If, for a fixed 1, 
AD = lim ZH 
пзе ба 


is negative, the series is convergent; whereas if the limit is positive, 
the series is divergent. 

In particular, when / = 0 Tests A and В yield d’Alembert’s test 
(Introduction, sec. 2). 


If the convergence of the series У a, is established with the 


n=l 
aid of Test A or B, we have on the basis of (3.20): 


—а —а 

——"—— и м. (3.25) 
inf PATA sup ZHR 

һ=т k+l ат k+l 


If the sequence {4;()) = (a,,,—2,)/a4,,) is monotonically in- 
creasing for k = m, we have 


— am 


2 "E (3.26) 
lim А+1 k 
Amst К бы 
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If the sequence (4,()) is monotonically decreasing for k = m, 
we have 


— а. — а, 
- m - = Rina = Е Fis 5 " (3.27) 
lim kl k т-+1 т 
h—x Ч ат 
EXAMPLE 9 
> I 
PET (3.28) 


It is easily verified that, if /-- 1 < 0, the sequence {4,() = (a,,,— 
—4,)/@,,,} for series (3.28) is negative and monotonically decreasing 
as from a certain k = N(I). If 1+ 1 > 0, the sequence (A,(/)) is negative 
and monotonically increasing. 

We therefore have, on the basis of (3.27) with /-- 1 = 0, as from a 
certain m = МІ) (say as from m = 1 when [= —1): 


1 (m+ 1? 
Эт = Кин = т бит о) ` 
When / + 1 > 0 we have to reverse the inequality signs in the above. 
For instance, on putting m+/ = 6, and accordingly assigning the 
following values to m and /: 


m 9 8 7 6 5 4 

1 | -3 -2 -1 0 1 2 
it may be seen that the best upper estimate is obtained with / = —1, 
and the best lower estimate with/ = 0, so that in this case 0-000686 = 
= К, = 0000703. 


2°. THE GENERALIZED Caucny Test. On putting b, = o" and 
applying Tests, I, II (sec. 3), we get the following convergence test, 
which may be regarded as a generalization of the Cauchy-Hadamard 
test. 

Test С. If, for a fixed l and o = 1, 


lim > 0, 


п n+l 
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E 
the series у, a, is convergent; whereas the series is divergent if, 
пы 
for a given l and о2 1, 
n 


0 = lim < co. 
n оо + 
When / = 0, this test yields the familiar Cauchy-Hadamard test 
(Introduction, sec. 2). 
If the convergence of the series can be established with the aid 


of Test C, we have by (3.19), for any m+/> 0, 


gm от 

0 = = Rn АА. (3.29) 
(1—0) зир — (1-9) inf — 

hzm 441 Вт аһ 


Here, о=1 is an arbitrary number, for which lim (0"/a,,,)> 0. 
n 
If the sequence {А„(Т) = оё аһ} is monotonically increasing for 


k = m, we have 


т 
ET = Кыш = тен : (3.30) 
(1—0) lim —— E 
&-> оо Rel 


Whereas, if the sequence {A,(/)} is monotonically decreasing for 
k = m, we have 


m 
I = Rmn 2 — BÉ . (3.31) 
ё (1-0) tim -— 
. h— 01 
EXAMPLE 10. 
Y S боев (3.32) 


PET 

It is easily shown that estimate (3.31) can be applied to series 
(3.32) on condition that m+/ = 3. 

On taking o = x, we have 


xmi amt 


mu LL ee Rr сш | 
(i—x)™ Уты "сх 


3°, RaaBE's Test. A particular case of the general Test Ш 
(sec. 3) is 
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Test D. The series У a, is convergent if, for any integral 1 = 0, 


nel 
A cda Pea c Dis ү, (3.33) 
n» оо antl 
and is divergent if 
АФ > 0. 
When / = 0, we get 
RAABE'S Test. The series У a, is convergent if 
n=l 
TELA 
lim (1-222) >], 
23 Rr co а 
and is divergent if 
п ( = ==) =1. 
а 
for all n = по say. 
EXAMPLE 11. 
= 1 
Е, 3.34 
a п(п+ 1) (n-- 2) 68-34) 


The convergence of this series is readily established by applying 
Test D. We can also make use here of the estimates for the remainder 
term of sec. 4, corresponding to cases (3), (c) and (3), (d). 

On applying estimate (3), (c) (sec. 4) with m = 9, and 1 = 2, we 
get 


(m— 1) (m4-3) qe Atos ccce d 
Qm—3) (n+ (mt+I+ 1) (т+1+2) "7 atit) 


(3.35) 


On applying estimate (3), (d) (sec. 4) with m+/> 0, [= 1 and 
т> 4l/(21—3), we have 


о бр mad 
(2m = 3) (m+) ("+141 @и+1+2) "НЯ 2 жт+1)(т+2)` 


(3.36) 
On comparing inequalities (3.35) and (3.36), say with m+/ = 12, 
it is easily seen that 
0-00315 = Ry = 0.00337, 
he true value here being Ry, = 0-00320. 
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4°. Gauss’s Test. If lim a,,,/a, = 1, d’Alembert’s test gives 
R-- оо 


no answer as regards the convergence of the series, as mentioned 
above. If the ratio a,,,/a, has the form 


алыу _ M+ pri gn) 
аһ А+” 


where ф(п) and y(n) have lower orders than n^7!, the convergence 
or divergence of the series may be established with the aid of the 
following test. 


Gauss’s Test. The series У a, is convergent when q—p> 1, 
nel 
and divergent when q—p = 1. 


EXAMPLE 12. When х= 1, the hypergeometric series (ref. 7): 


ab a(x-- BBE) e(x-4- D («+2)8(В+ D (8+2) 
1.7 1.2.у(у+ 1) 1.2.3.y(y + 1) (у+2) 


is convergent provided that 


+ +... (3.37) 


у>@+8. 


Notice that, from a certain n onwards, series (3.37) is of constant 
sign for any real х, В, у (it is assumed that none of the numbers «, 
B, у is negative). 

We have in the present case, say with / = 0, 


.Ce€0-20-80 , ,. 
A,(0) = C ET (y-—«—B) 
and 
AQ) = —(у—®—8) = 0. 


On observing that, for alln > — у, the sequence (4,(0)) will be mono 
tonically increasing or monotonically decreasing, and making use 
of (3.26) and (3.27), we get 


(т-+у)талһ Ер = Um 
(т-у) 0——Б)—(у—)(у—В) = "= y-ap’ 
(т > —») 
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where 
: _ 8(xD...(x4 m- 10)8(8+1)...(8+т-1) 
= т\у(у+1)...(у+т—1) А 
5°. CaucHy’s INTEGRAL Test. Let the general term of the series 


У а, be monotonically decreasing with increasing л. Obviously, 
nml 

it is now possible to choose an infinite set of positive functions a(x), 
monotonically decreasing and continuous for х > 0, and such that 


a(n) = ap. 
Let a(x) be one of these functions. The series Y 4, is now converg- 
ent or divergent, according as the improper integral 
| ” atx) dx, (3.38) 
а 


where о = 1, is convergent or divergent. 
This test follows as a particular case from general Tests I and II 
(sec. 3), if we put say 


T1 
b, = [i a(x) dx and /=0. 
п 


EXAMPLE 13. We ате given the series 


р T (с> 0). (3.39) 


We choose as a(x) the function 1/(х In! *" x) and put æ = 2, so that 
= z М : 
~ с10°2' 


isi 1 1 
| х1п!+° х GE cin? x 
the series is therefore convergent. 
EXAMPLE 14. We are given the series 
2. ninnininn* 
We choose а(х) = l/(xIn x In ln x) and put х = 3: 


(3.40) 


оо 1 cc 
f xinxini z^ = mhlx ==, 


So that the series is divergent. 
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EXAMPLE 15. Given the series 


putem (3.41) 


т=п 


we choose а(х) = 1/х° and рш а = 1. On recalling that 


we get: 


* dx | 1 for o>1, 
с—1 
со for osl. 


The series is thus convergent for o> 1 and divergent for o = 1. 
Notice the following points: 

(1) In view of the fact that the choice of the function а(х) is to a 
large extent arbitrary, an infinite set of estimates can in general 
be quoted, corresponding to the test. 

(2) When the sequence {a,} is monotonic, estimates correspond- 
ing to Cauchy’s integral test can be used, independently of the 


particular test used to prove the convergence of the series ¥ ap 
n=l 
EXAMPLE 16. 


n 
У = (а > 1). 
nay @ 
Let a(x) = х/а*, say. The function a(x) is monotonically decreasing 
for x> Шова. Therefore, on evaluating 
gk [hri a~1 а—та-1 


= — ==. = —— + — 
4 К " аул alna ka in? a 


and making use of estimate (3.26), we have 


m(m In a+ 1) z а. а „гае! | 
am-ya—D(minat 1-24 а мапа 


(т = 1). 
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6°. М. V. BuGAEv's THEOREM; V. P. ERMAKOV'S Test. Let a(x) 
be the function introduced in the statement of Cauchy’s integral test, 
and 6(x) some positive differentiable function, increasing as x increases 


and such that lim 1/0(х) = 0. The following theorem can now be 
х ое 


obtained on the basis of Cauchy’s integral test. 
THEOREM 3 (М. V. Bugaev). If the function ó'(x) a[8(x)] is mono- 
tonic for sufficiently large x, the series у a, and Y, 8'(n)a[6(n)] 
n=l 


n=l 
are simultaneously convergent or divergent. 


Thus any convergent test applied to the series У д'(п)а[д(л)) 
ne] оо 
will at the same time yield a convergence test for the series У a,. 
nel 
In particular, we have the following corollary of N. V. Bugaev’s 
Theorem. 
V. P. ERMAKOV'S Test. № 
ета(е") <1. 
m-»« a(m) 
the series у. a, is convergent; whereas if 
nel 
e™a(e™) 


m=- (m) 


the series is divergent. 
+1 
On putting say b, = ó'(x)a [6(x)] dx and using the general 
п 
tests of sec. 4, an infinite set of estimates can be obtained (for the 


remainder term of the series У 4,) corresponding to different 
nel 
methods of choosing the functions ó(x). 


7°. LOBACHEVSKII'S TEST. If the terms of the series 


У a(n) 


n=1 


are monotonically decreasing, then the series is convergent or divergent 
at the same time as the series 


У Pm2-™, 


т=1 
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where рт is given by 
Pm) = 27", а(рһ+1) = 2". 
We can also define ри from the equation 
APm) = 27", 


if the function a(x) is monotonic and defined for any value of x. 
EXAMPLE 17. 


The equation 


1/p3, =2™ 
lm 
gives us Pm = 2? ; we form the series 
У Pm2-™ = у 2 
т=1 т=1 
This is a convergent geometrical progression, so that the series 
sel 


iw 


nal 


„өз 


s also convergent. 


6. The convergence of alternating series 


Given the alternating series (3.8), we form series (3.8*) from the 
absolute values of its terms. 

To-establish the absolute convergence of series (3.8), we can apply 
to the positive series (3.8*) all the tests described above for series 
of constant sign. As already mentioned, however, tests for the con- 
vergence of series (3.8*) may not be valid for series (3.8). 

Alternating numerical series. Alternating series are those, the terms 
of which are alternately positive and negative. The following holds 
for such series: 


THEOREM 4 (Leibniz). If the terms of an alternating series У аһ 
nel 
are monotonically decreasing in absolute value, 


lanti] = lan | (п = 1, 2, 3, ..) 
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and the n-th term tends to zero, 
lim a, = 0, 


п co 
the series is convergent. 
Estimation of the remainder term of an alternating series is simple 
and effective. 
The remainder term of an alternating series that satisfies the con- 
ditions of Leibniz’s theorem, 


Ra = anyit angot 3 
has the sign of its first term a,,, and is less than it in absolute value: 


| Ral = anyit nanc vee 


The criteria for convergence of Abel and Dirichlet are more general 
than Leibniz's test. ' 
Suppose we have the series 


p3 nbn = mbit abat ... аб. + ..., (3.42) 


where {a,} and {Б} are sequences of real numbers. 
ABEL’s TEST. Series (3.42) is convergent if the series 


È = ++... ++... (3.43) 
n=l 
is convergent, while the numbers а„ form a monotonic and bounded 


sequence: 
[2.1 = К (п = 1, 2, 3,...). 


ЕХАМРІЕ 18. 
ре 1 1 1 1 
(ж) з=: ag ME LT 


DIRICHLET’S TEST. Series (3.42) is convergent if the partial sums 
of series (3.43) are bounded in aggregate: 


|һһ М — (n212,3...) (3.44) 


while the numbers a, form a monotonic sequence tending to zero: 
lim а, = 0. 
no 
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Assumption (3.44) is more general than the assumption of the 
convergence of series (3.43), so that Abel’s test is a consequence of 
Dirichlet’s test. 


7. Infinite products and their convergence 


Suppose we have a sequence of numbers (or functions) 


Po Pas Par vee Pry +++. (3.45) 
The symbol 
Пл = PuP2Ps---Pn--- (3.46) 
n=l 


s known as an infinite product. 
The product of a finite number of consecutive terms 


Р, = py, Р, = рр» Ру = PiPPa ..., Pn = PiPa-++Pn-iPn (3.47) 


is called a partial product. The sequence of partial products will be 
denoted by (P,). 


EXAMPLE 19. А 
gsm» 14 25 36 
П ф+ул+® ey cee oer aa 


The convergence of infinite products. 
Four fundamental cases may be distinguished. 
(1) The sequence of partial products {Р„} has a finite limit different 
from 0: 
lim Р, P. (3.48) 


"n ос 


This limit is called the value of the product and is written as 


P=J] Py (3.49) 


1 n+3 1 
n— оо 3 п+1 “г. 
(2) The sequence (P,) tends either to + œ, or to — оо. 
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EXAMPLE 20. 
J] п=1.2.3...т...; Р, = п; lim и! = о. 
n=l п oo 
(3) The sequence {P,} has the limit 0. 
EXAMPLE 21. 
1 Я 
Р = у for any n, п, Py = эт, lim ox = 0 


(4) The sequence (P,) has no limit (e.g. oscillates). 
EXAMPLE 22. 


TY n ми -3 _ 
IC” ssec 


214( 2.543.6( 4.7) трал 
2.34 3.4]4.5\ 5.6] "^ 3 RUSO 


In the last three cases the sequence is said to be divergent. Case 
(3) ( lim P, = d implies a different classification to that accepted 


n> оо 
for infinite series. However, this is convenient for the statement of 


many theorems on infinite products. 
An infinite product can be written in the form 


П Pn = Ралым, (3.50) 


n=l 
where 


Pm = PiPa+++Pm 
is the partial product of the first m terms, and 


пт = РезаРт+ = [E Pn (3.51) 
п=т+1 
is called the remainder product, this being analogous to the remainder 
term: of a series. 
THEOREM 5. If product (3.46) is convergent, the remainder product 
(3.51) is also convergent for any m (if all the p, з 0); the convergence 
of the remainder product implies the convergence of the original product. 
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Thus discarding a finite number of initial factors or combining 
at the start a finite number of factors has no effect on the convergence 
of an infinite product. 

If an infinite product is convergent, then 


lim ли = 1. (3.52) 
m-— со 
This follows from (3.50); 
P 
Nm = P. 
m 


and from the fact that P ; 0. 
If an infinite product is convergent, then 
lim p, = 1. (3.53) 


п оо 


This follows from the chain of equations: 


In the case of a convergent product, p, > 0 as from a certain n. 
This follows from (3.53). In view of Theorem 5, we can assume with- 
out loss of generality that all the p, > 0. 

There is a connection between the convergence of infinite products 
and that of series. 

A necessary and sufficient condition for convergence of the infinite 
product (3.46) is that the series 


У In py (3.54) 
n=1 
be convergent. 
If S is the sum of series (3.54), we have 
Р = е5, (3.55) 
On writing s, for the partial sum of series (3.54), we have 
Sn = In Py, Р, = ез. (3.56) 
It follows from the continuity of the logarithmic and exponential 
functions that, when P, tends to a finite positive limit P, the partial 


sum 5, tends to In P, and conversely, if the finite limit S exists, the 
limit for P is equal to е5. 
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The nth term of an infinite product may be conveniently written 
as 
Ри = 1+4 


and product (3.46) written as 


П asa (3.57) 


n=l 


while series (3.54) is written as 


У ша+а,. (3.58) 
nel 
THEOREM 6. If, for sufficiently large n, all the a, > 0 (or a, = 0), 
the necessary and sufficient condition for convergence of product 
(3.57) is that the series 
У а. (3.59) 
"zi 
be convergent. 
A necessary condition for convergence of (3.57) and (3.58) is that 


lim a, — 0, whence lim in (1+ an) 
n оо n> æ An 


em. 


In the general case a, > 0, the infinite product (3.57) is convergent 
if the series 
Ў a. (3.60) 
n=] 
is convergent along with series (3.59). 
The product of Example 19 can be written as 


= onma-3 _ > 2 
Й eee (cene) 


n=l 
Here 
B -2 
" (n4-1 (42) 
and 


lim a, = 0. 
n—> оо 


SERIES 109 


The following will make it clear why, in the case 
P=0, 


the infinite product is classified as divergent. 

The necessary and sufficient condition for the infinite product to have 
a zero value is that series (3.54) or (3.58) have the sum — «e. 

This is the case for example when a, -- 0 and series (3.59) is diver- 
gent, or, when series (3.59) is convergent, but series (3.60) is diver- 
gent. 

Product (3.46) is said to be absolutely convergent when series 
(3.54) of the logarithms of its factors is absolutely convergent. 

An absolutely convergent product has the commutative property. 
The necessary and sufficient condition for absolute convergence of 
product (3.57) is that series (3.59) be absolutely convergent. 

We have, for Example 19: 

2 1 1 


2 


lanl = аур" Стейн “2 


But У 1/n? is a convergent series (see example 15), so that the 
n=1 
product is absolutely convergent. 


It may be remarked that the theory of functional products bears 
the same relationship to the theory of numerical products as the 
theory of functional series to that of numerical series. Let us give 
an example of a functional product. 

EXAMPLE 23. The product 


оо x 
xIT l-r 


represents sin x for any x. 


8. Double series. Fundamental concepts and definitions 


In addition to ordinary (simple) infinite series, multiple series are 
employed in analysis and applied mathematics, e.g. double, triple, 
etc., series. We shall confine ourselves here to a brief outline of the 
theory of double series. 
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DEFINITION. A double series is defined by the symbol 


оо 


Y È an (v У a): (3.61) 
heo 1=0 k, 1=0 н 
and is made ир of the terms of the double sequence {ap} (К = 0, 1, 
2,3, ...; [= 0, 1, 2, 3, ...); corresponding to it, we have а double 
sequence {Smn} of partial sums 


һ=т—1,[=п—1 
Smn = М 2A ан. (3.62) 


If a finite limit exists on simultaneous and independent increase 
of the indices m and n, 


S= lm зы = У ag, (3.63) 
N—> оо k, 1=0 
т> оо 


the limit is called the sum of the double series (3.61), and the series is 
said to be convergent in this case; otherwise it is divergent. 

If the terms а, are summed consecutively, first over one index, 
then over the other, the double sum will be described as an iterated 
series, Obviously, the following two cases are possible here: 


Y ( ў 2 (3.64) 
leo \Ё=0 


y (X в). (3.65) 


Iterated series (3.64) is said to be convergent if the series 

А = 2s аһ, (3.66) 
(for any fixed subscript Г) and 
A, (3.67) 
I 


are convergent. 
Similarly, series (3.65) is said to be convergent if the series 


В, = à ац (3.68) 
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(with any fixed subscript k) and 


y By (3.69) 


are convergent. 
Let us introduce the notation 


A= lim ( lim Sma) 2 (3.70) 
п» оо m оо 
Similarly, 
B= lim үп Smn) > (3.71) 
Т > ре ХП > ое 


A series for which all the а, = 0 is called a double series with 
positive terms. 


If the double series У аһ and У |а| are simultaneously 
k, [=o k, [=o 
convergent, the double series is said to be absolutely convergent. 


= Е 
Whereas if x аы is convergent, but X lay] is divergent, the 
k, [=o ‚Т=о 


double series У аш is non-absolutely (or conditionally) conver- 
k, i0 
gent. 


9. Some properties of double series 


I. If double series (3.61) and series (3.66), (3.67) are convergent, the 
iterated series (3.64) is also convergent and has the same as the double 
series. 

Similarly, the following property holds: 

П. if double series (3.61) and series (3.68), (3.69) are convergent, 
iterated series (3.65) is also convergent, and has the same sum as the 
double series. 

REMARK. Generally speaking, the convergence of series (3.66) and 
(3.68) does not follow from the convergence of double series (3.61) 

Ш. The necessary and sufficient condition for the convergence of 
the double series (3.61) with positive terms is that its partial sums be 
bounded. 

IV. If one of the three series (3.61), (3.64) and (3.65) with positive 
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terms is convergent, the other two are convergent and have the same 
sum. 

A one-to-one correspondence can be established between pairs 
of equal terms of the double sequence {a,,} and the ordinary sequence 
{5.}. We shall say for rented in this case that the double series 


Y ац and the series » b, consist of the same terms. 
k, leo з=0 


V. If the double series У аһ and the series У b, consist of 


k, 1=0 ren) 
the same terms, the convergence of one implies the convergence of the 


other, and they have the same sum. 
VI. If the double series Y lay] is convergent, the series Y ац 
is convergent (but the inei dies not hold). TM 
VIL If the double series у ay, and the series y b, consist 


k, 1=0 80) 

of the same terms, the absolute convergence оў one implies the absolute 
convergence of the other. Both series now have the same sum. 

УШ. The terms of an absolutely convergent series can be rearranged 
in any manner without changing the sum. 

The above properties can be useful in proving the convergence, 
and computing the sum of a double series. 

EXAMPLE 24. It is easily shown that the double series 


ы 1 
ОЕ G2) 


is convergent for «> 2 and divergent for « = 2. 
For, on putting k+/ = т, we find that m— 1 terms of series (3.72) 
are equal to 1/т". Series (3.72) can therefore be written as the simple 


series 
= т—1 = 1 e». | 

— = —==—- =: 3.73 
v т° > m^ „5, т° ‹ ) 
Both the series on the right-hand side of (3.73) are convergent for 
æ> 2 (Example 15), so that the series on the left-hand side is conver- 
gent. By Property V of double series, the double series (3.72) is also 
convergent, and its sum is equal to the sum of the simple series (3.73). 
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10. Some convergence tests for double series of positive terms. 
Estimates of remainder term 


A necessary condition for the convergence of any double series 


У ац is that 
k, [0 . 
lim ag = 0, (3.74) 
k => о 


1— оо 


when К and 1 tend to infinity independently of each other. 

A stricter necessary condition than (3.74) can be given for the con- 
vergence of double series with positive terms. 

For a double series with positive terms to be convergent, it is necessary 
that 


lim Y ay = 0 (3.75) 
k— оо [=0 

and 
lim Y ay = 0, (3.76) 


l—> оо R20 


so that all the more, the following conditions must be satisfied: 


k 
lim Y ay = 0 (3.77) 
k— co lag 
and 
1 
lim Y аы = 0. (3.78) 
l—> æ Кт) 


From (3.77) and (3.78), we see that the following conditions must 
also be satisfied: 


lim ay = 0, 
k => ә 

L— оо 

lim ар = 0 for any l, (3.79) 
k => оо 


lim ан =0 for any К. 
1—> оо 


As in the case of ordinary series with positive terms (see $ 1, sec. 
3—5), comparison of the terms of two series leads to a number of gene- 
ral tests for the convergence of double series with positive terms, and 
corresponding remainder term estimates can be given. 
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Suppose we have the double series 


eo 


у; а (3.80) 


k, 1=0 


with positive terms, and some other series 


оо 


by. (3.81) 
k,i=0 


We assume that the convergence or the sum of the series (3.81) is 
known to us in advance. We introduce the notation: k+l == n, 


lim Pu = А, (3.82) 
вора UTE 

п бы - 

lim += A. (3.83) 
п oo kl 


lim bu EA (3.84) 
n— co Akl 
The remainder term of double series (3.80) will be defined by 
Rim = mot Гот + mm: (3.85) 
where 
Rec, i m—1 һ=тт—1,1=оо 
mo = apy Гот = ац 
heh, leo km, (=m 
and 
тт = Y ац. 
k, l=m 


We shall write B,,, for expression (3.85), corresponding to the 
remainder term of series (3.81). 

Using the above notation, the following general sufficiency tests 
can be stated for the convergence of the double series (3.80): 

1°. 110 = B, + eo for ай т> М and А > 0, the series is convergent. 

2°. If > < B, 0 for all m > М and A< 0, the series is converg- 
ent. 

3°. If, with finite A and А. of the same sign, Вии = + œ, the series 
is divergent. > 
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4. If O< Bas +> for all т> № and the conditions 
— 9 < 4 < and = + оо аге satisfied, the series is convergent. 

5°. If — © < Вит < 0 for т > М and the conditions — «o = А<0 
and A = — ee are satisfied, the series is convergent. 

When series (3.80) is convergent, the following estimates hold 
for the remainder term: 


Втт _ = = Bam 

Ка И. (3.86) 
e бы = = by 
inf — sup — 

him UR кЕ+1=т @ңһ( 


When A= ог А = — ® (ог А = Xe) 


(3.87) 


Further, on choosing the b, by different methods, we can obtain 
from the above general convergence tests various practical tests which 
are sufficient for the convergence of a double series with positive 
terms. Inequalities (3.86) and (3.87) enable us to give remainder term 
estimates corresponding to the convergence test chosen. 

We shall confine ourselves here to oneconcrete case, e.g. by putting 


by = Onan, tei @а+1,1— PR 141 T Pte (3.88) 
It now follows from the above general tests that the double series 


> аы is convergent if: 


А, 10 
(1) lim a5, = 0; (3.89) 
p-> 
(2) A= lim ^ M Log. (3.90) 
7o RET Soo Uh 
and is divergent if: 
I=- da ig. (3.91) 
hb — œ Aki 


The remainder term estimate corresponding to this test has the 
form 
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Amo + lom — €. Amo + дот — а 
то 0m $ тт = Ron = mo От 7 тт. : G 92) 

hl : hl 

sup — inf — 

k+l=m Gp} hm Ч 


where b, is given by equation (3.88). 

Fulfilment of condition (3.90) only is not sufficient for convergence 
of the double series. 

EXAMPLE 25. The series 


==, AG) G) 


is obviously seen to be divergent; at the same time, the condition 
А = 012-0 is satisfied although lim арр = ee. 


р 
р- = 
EXAMPLE 26. Let us take the double series 
> 1 
Tal. Eee’ 
Condition (3.89) is satisfied here, since 


$ (3.93) 


lim app = lim T 80 0 
poe © »-[KP-DP ` 


We have by (3.90): 


lim Бы lim Ptit 4191 Sep tAn _ 
А+ ә Ош  Е+1-—>е ащ 
1+1 | 
12 for fixed /; 
(k+) 0+1) k41 
= — == — f f d k; 
bue (632042 =] Её 0 e 


1, if simultaneously 
k and l= œ, 
But obviously, 7. = (1+1)/1+2)= 1 and js (k+1)/(K+2) = 1, 
ie. A = > for all k, 1 = 0. Series (3.93) is thus convergent. 


To estimate Ry», in accordance with (3.92), we first observe that, 
for the function F(x, у) = (х+1) (y-- D/G-r2) (7-2), necessary 
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conditions for an extremum: OF/Óx = ӨР]ду = 0, are not satisfied 
for any finite positive x and y, ie. the greatest and least values 
of the function can only be attained on the boundary of the domain 
MBX, у< оо, 
Jt may easily be shown by using this fact that 
: by ee (K+1I)U+1) mel 1 
inf == inf но. 
+1=т@н инет (+2) 1+2) т+2 2 
апа 
(k- D 1) 
sup = 1. 
кн» &+2) (42) 


On substituting the values obtained in inequality (3.92), we get 


2 1 4(m +2) 2(m +2) 


n DU m DÉ nius a+ mt)! mF) 00 


For instance, we obtain with т = 4: 
0.0159 = Ram = 0-0382. 


§ 2. Series of functions 


1. Fundamental properties and convergence tests 


We shall discuss functional series in this article, i.e. series whose 
terms are functions. We shall confine ourselves simplicity to the series 


ш) ни)... Hig oe = b» wx, G) 


the terms of which are functions of a single variable. Immediate 


generalization is possible to the case of two or more variables. 
DEFINITION. The expression (3.94) is called a functional series; 
it is formed from the terms of the function sequence (u,(x)), defined 
on the set X = {x} of the numerical axis E,, and has a corresponding 
sequence {Sp}: 
n 
$4 = Y ик(х) 
к= 
of partial sums. 
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There are different types of convergence for the function s,(x): 
uniform, non-uniform, in the mean, etc. Corresponding to these we 
have different forms of convergence of the functional series. 

Let the sequence {s,(x)} be uniformly (non-uniformly) convergent 
on X to the function S(x). Series (3.94) is then said to be uniformly 
(non-uniformly) convergent, and S(x) is its sum: 


S(x) = i us(X). (3.95) 
n= 
A Condition for Uniform Convergence of a Series: The necessary 
and sufficient condition. for series (3:94) to be uniformly convergent 
on X is that, given any => 0, there exists an N independent of x such 
that, given any п> М and any m = 1, 2, 3,..., the inequality 


БИЛ 


kent. 


<E 


holds for all x € X. 
If all the terms of series (3.94), uniformly convergent on the set ¥, 
are multiplied by the same function v(x), bounded on Х, 


POIS М, 
the uniform convergence is preserved. 
Tests for uniform convergence of series. 


1°. WEIERSTRASS’S TEST. Jf the terms of series (3.94) satisfy on the 
set X the inequalities 


A631 = Cp (п = 1, 2, 3, ...), (3.96) 


where c, are the terms of a convergent numerical series, (3.94) is uni- 
formly convergent on X. 
When (3.96) holds, the series 


E 
У Cn 
n=l 


is described as majorant for series (3.94). A functional series satisfying 
Weierstrass’s test is absolutely convergent, and moreover, the series 


PL 


is uniformly convergent. 
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Cases are possible when series (3.94) is uniformly but not absolutely 
convergent. 
The following tests hold for functional series of the form 


oo 


2 а„(х)Ь„(х) == aG)b,G) +... aba Q)b (х) + .... (3.97) 
n= 

2°. AnEL'S TEST. Series (3.97) is uniformly convergent on a set X 
if the series 


2 в, = b) b)... (3.98) 


is uniformly convergent on the set X, while the functions а„(х) form 
a monotonic sequence for any x, and are bounded for any x and п; 


Га» (х)| = К. 


3°. DIRICHLET'’'S Test. Series (3.97) is uniformly convergent on 
the set X if the partial sums s,(x) of series (3-98) are bounded for 
all x and n: 
[09| = М, 


while the functions a,(x) form, for any x, а monotonic sequence, uni- 
formly convergent to zero on the set X. 

Let us also note some properties of the sum of a functional series. 
If the functions u,(x) of series (3.94) are defined in the interval 
X = (a, b) and are all continuous at the point x = x, of this interval, 
and in addition, series (3.94) is uniformly convergent, the sum S(x) 
of the series is also continuous at. the point x = хо. 

The following proposition is a consequence of this: if the functions 
u,(x) are continuous throughout the interval X = (a, Б) and if the 
Series is uniformly convergent there, the sum S(x) of the series is 
continuous throughout the interval. The uniform convergence in 
these propositions is a sufficient but not a necessary condition, since 
there are series, non-uniformly convergent in an interval, having a 
sum continuous in the interval. We shall not state here necessary 
and sufficient conditions for continuity of the sum of a series, and 
shall only mention that uniform convergence is necessary and suffi- 
icent provided the terms of the series are in addition positive in the 
interval. 
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Term by term integration of series, If the terms u,(x) of series 
(3.94) are continuous in the interval Х = (a, b) and the series is 
uniformly convergent in this interval, the integral of the sum S(x) of 
the series is equal to the sum of the integrals of the terms: 


| бок Ў [оа (3.99) 
a n=l Ja 


In other words, term by term integration of the series is permissible 
under these conditions. 

The following is a generalization of the above theorem: if the 
terms u,(x) of the series are integrable (in Riemann’s sense) in the 
interval Х = (a, b) while the series is uniformly convergent, the sum 
5(х) of the series will also be integrable and (3.99) will hold. 

Term by term differentiation of series. If the terms u,(x) of series 
(3.84) are defined in an interval X = (а, b) and have continuous 
derivatives и’(х) in X, and series (3.94) is convergent in X, while 
in addition the series formed from the derivatives 


= U(x) = ux) ++... ru... 


is uniformly convergent, the sum S(x) of series (3.94) has a derivative 
in X, and 

S@= Y wx) (3.100) 

nel 

in other words, the derivative of the sum is equal to the sum of the 
series formed from the derivatives, i.e. term by term differentiation 
of series (3.94) is permissible. It may be mentioned that the restric- 
tions of this theorem can be somewhat relaxed (see ref. 11, vol. II, 


$ 407). 


2. Power series 


This branch of the theory of functional series is particularly import- 
ant. 
A series of the form 


Y а(х Xp)" = ag Hax x)... ax)... (3.101) 


n=O 
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is called a power series. On substituting x, = x— хо (we shall omit 
the subscript 1), it reduces to the form 


У anx" = паха... +a,x™+..., (3.102) 
n=0 
with which we shall be concerned in what follows. 

There are three possible cases. 

Case 1. Series (3.102) is convergent for any real x, i.e. throughout 
the axis Ё,. In this case the series is said to be convergent everywhere. 

Case 2. Series (3.102) is convergent only for x = 0, The series is 
now said to be divergent everywhere. 

Case 3. The series is convergent in some interval (—R, +R), 
0< К< +œ; the number А is called the radius of convergence of 
the series. 

We shall accept the convention that Case | corresponds to a radius 
of convergence К = æ, and Case 2 to a radius of convergence R = 0. 

EXAMPLE 27. The series 


is convergent for any x (В = e). 
EXAMPLE 28. The series 


Y nix" = х+21 +31 +... 
nal 


is convergent only for x = 0 (R = 0). 
EXAMPLE 29. The series 


»EES L+xtx+... 


n=l 


is convergent in the interval (-1, +1) (R = 1). 
EXAMPLE 30. The series 


xc aud x 
wp EUR 


is convergent in the semi-interval (—1, +1) (В = 1). 
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EXAMPLE 31. The series 


Фат 9 
is convergent in the segment [—1, +1] (В = 1). 
If the limit 
a 
lim |= p, 
п о | Un S 


exists, (see d'Alembert's convergence test) then 


1 
R= z (3.103) 
(R = œ for ọ = 0, R = 0 for = œ). 
On starting from Cauchy’s test, we get 
Peas, (3.104) 
e Ша а, 


И series (3.102) has a radius of convergence R > 0, no matter what 
the positive number r< R, series (3.102) is convergent uniformly 
with respect to x in the segment [—r, r]. 

The sum S(x) of series (3.102) is a continuous function of x for 
all x between — Rand R. 

THEOREM 7 (on the identity of power series). Jf two power series 


» a,x" and Ў b,x" 
n=0 n=0 


have the same sum in the neighbourhood of the point x = 0, the series 
are identical, i.e. their corresponding coefficients are equal: a, = b, 

The following propositions concern the behaviour of a power series 
at the ends of the interval of convergence. If power series (3.102) 
is divergent at an end of the interval of convergence, the convergence 
cannot be uniform in the semi-interval (0, R). 
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The converse is: if the power series (3.102) is convergent for х= К 
(x =— К) (even non-absolutely,) the series is uniformly convergent 
throughout the segment (0, R] ( [—R, 0]). 

THEOREM 8 (Abel). Jf series (3.102) is convergent for x = R, its 
sum remains continuous ( from the left) for this value of x, i.e. 


lim S(x) = S(R). 
x—R-0 


See Example 30 for x = —R = —1апа Example 31 forx = — R= 
== —1, х= Кош 1, 


3. Operations on power series. Taylor series. Integration and 
differentiation of power series 


(a) Power series (3.102) can be integrated term by term in the 
segment [0, x], where |х| = R: 
х оо x оо х1 
5(х) 4х = Y | аа = У a,——; (3.105) 
° n=0 Jg n=o n+l 
x may reach the end of the segment at which series (3.102) is con- 
vergent. 
(b) Power series (3.102 ) can be differentiated term by term as many 
times as desired inside its segment of convergence: 


oo 


S'(x) = У пах", 


n=l 


S"(x) = 2 n(n— la,x?7?, 


n= 


Sem) = У n(n—1)...(n— т+ Da,x?77; 
nzm 


this also holds for an end point of the segment at which the series is 
convergent, 

Taylor series. Different forms of the remainder term. A function 
expressible as a power series in its interval of convergence has deriv- 
atives of all orders inside the interval. The series itself is the Taylor 
series of the function. 
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If the function is expanded as a Taylor series in the neighbourhood 
of the point xo 


Л) = 2 a(x — хо)" (3.106) 
ne 
in this neighbourhood, where 


E af ш (0! = 1). (3.107) 


The particular case of а Taylor series when хо = 0 is sometimes 
called a Maclaurin series. As follows from (3.106) and (3.107), it has 
the form 


ДӘ = Y ae, (3.108) 


where 


E f 90) 


Ы п! 


On confining ourselves to a finite number of terms in a Taylor 
series, a function f(x) can be written as a partial sum s, of the series 
plus a remainder term r,: 


п eo 
fo) = у a(x—xQ)'- У ах хо) = вх) Hra). (3.109) 
km0 ken+i 
When x - хо, the remainder term r,(x) is an infinitesimal of order 
higher than n (compared with x— x9). There are various familiar 
forms of the remainder term of a Taylor series. 
The form of Schlómilch and Roche: 


(n--1) S | 
Пров x9 po: = Xol gpt- ха. (3.110) 
Неге p>0, O< 6<1 

On assigning concrete values to », we get more specialized forms 
of the remainder term: 

Lagrange's form (р = п-+ 1): 


r, „(х) = 


(n+1) = 
P(X) = ре е л! (х= хо (0=8<=1. (3111) 
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Cauchy's form (p = 1): 


oS D 86 x9 (1-89 (x—x* 0=8=1. 
(3.112) 


In spite of the indeterminate size of 0, these forms of the remainder 
term enable us to estimate the accuracy of replacing f(x) by the nth 
degree polynomial s,(x). If the (n--l)th derivative is bounded in 
absolute value in the interval between x and x, by the number М, 
we have from (3.111): 


rx) = 


M|x— Xo +1 
(п+ 1)! 
EXAMPLE 32. The Taylor expansion of the function f(x) = е^ in 
the neighbourhood of the point хо = 0 is 


Ira) | = 


x x х" 
е = Depp eee tay tra), 


where 
3 xn*i xn*2 
nO e Gm UU 
By (3.111): 
ee 
Раны 


Here (when х> 0): 
ха 
|0) [| = e* GIDU 


For instance, when x = 1: 
3 
LOIR QD 


The remainder term can also be expressed in the integra! form, 
which contains no indeterminate numbers: 


n) = = | © ge) (хдта. (3.113) 
Xo 
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We can write, in the above example: 
1 х 
nO == | e(x — ty dt, 
ni n 


Notice that a Taylor series may be convergent, and not represent 
its generating function f(x). 

EXAMPLE 33 (Cauchy). Let ф(х) be a given function, expressible 
in the neighbourhood of x = 0 by the series 


p(x) = e) 4 909 ED а Ens (3.114) 


We add to it the function p(x) = e^!/?, If we complete the 
definition of у(х) by putting y(0) = 0, both p(0) and all its derivatives 
y" (0) vanish, so that the Taylor expansion of p(x) in the neigh- 
bourhood of x = 0 is identically zero. But now: 


ДӘ = 2) = FEO + Ри... Quis) 


It is clear from this that equality of the expansions of the functions 
(3.114) and (3.115) does not allow us to deduce the equality of the 
left-hand sides: f(x) # ф(х). 

In general, if two functions f(x) and ф(х) are equal at x = xy 
and all their derivatives are equal, while at the same time the functions 
are not identically equal, their Taylor expansions are nevertheless 
the same in the neighbourhood of x = ху. 

Various operations on power series. Substitution of a series into a 
Series. Suppose we have the series 


2 = Ду) = Qtaytayrt ...= Хат (3.116) 


convergent in the interval (— R, R). The variable y is expressible in 
turn as a power series in x: 


у = p) =b bx by... Y bx", (3.117) 
nao 


convergent in the interval (—r, г). Say we want to express 2 as a 
power series in x and to find the interval of convergence of the series. 
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On formally substituting series (3.117) into series (3.116), we get 


z= Y Аш", (3.118) 
n=0 
where 
Ag = ayt abo а + ..., 
Ay = ab, + 2asbob, + Заз + ..., 
А; = 


Oyby + а + 24) + 2aalbob? +) +... 


The question of the convergence of series (3-118) is answered by 
THEOREM 9. 1°. 7f 
[bol > R, 


series (3.118) is divergent, whereas, if 
lbol < R, 
the series is convergent in the interval (— R,, Ку), where 


R = (К—|5|)о 


= | 3.119 
M+R-|b | ( ) 


о being an arbitrary positive number that satisfies the condition o < г 
and can be taken as close as desired to r, while M is the least upper 
bound of the numbers | bp! o^ (m = 1, 2, 3, ...), so that | b, | o" M 
or ай m. 

2°. If by = 0, series (3.118) will be convergent in an interval (— Ry, 
Ry), where 
. Re 
~ M+R° 


3°. If the series т = у, a,y" is convergent for all y, i.e. in the interval 
(— œ, + ә), series (3.118) will be convergent for | x | = г, i.e. in the 
interval (—r, г). 

Multiplication and division of power series. 

THEOREM 10. The product of the series 


А, 


Лх) = X a,x" and ф(х) = È bax”, 
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convergent respectively in the intervals 
1 = (- Е, К) and Ь=(—К„ В»), 
is given by the equation 
Ех) = /(х)ф(х) = соох сх? +... = у сих" 


n-0 
where Cy ауры, c, = agb rabo, Cy = ао, + Һа, etc., 
and is convergent in the smaller of the intervals Г, Ip. 
The quotient of the division of 1 by the power series 1+ Y b,x": 
n=l 
TON ЗЕ 
1+ $ bx? 


nel 


fx) = 


convergent in an interval (— г, г), is given by the series 
fo) = 14Ayxt А+... = 1+ Ў Age, (3120) 
n= 


where 4, = —b, A: = b?— ba, Аз = —b8+2b,b,—by, etc. 
THEOREM 11. Series (3.120) is convergent in the interval (— o] [M 4-1], 
ol [M - 1D), where 0 < о < г and о can be taken as close as desired 
to r, while М is the least upper bound of the numbers | Би |o" (m = 1, 
2, 3, ...). 
We can easily pass from this to the division of one power series by 
another: 
S T 
ф(х) = Ay taxat... = PL 
ү)  botbix + gx? +... > ne 


nao 
We have 
1 
55 = detras tex oe GE Ax Ax...) 
where 


14 дм = р 
к 14—-¥ b,x" 
bo 1 
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is obtained as indicated above. The expansion 


is now convergent in an interval determined by the above theorems. 


4. Complex series 


A numerical (or functional) complex series 


Ў en (3.121) 


n=l 


is one in which the terms are complex numbers (or functions): 
Cn = Gn +. (3.122) 


The convergence of complex series (3.121) to the sum S = 4+iB 
is equivalent to the convergence of two real series 


Y (3.123) 
nel 
È bu (3.124) 
n=1 
to the sums A and B respectively. 


We have: 
THEOREM 12. If the positive series 


5 [алі = b Мати, (3.125) 


composed of the moduli of the terms of series (3.121), is convergent, 
series (3.121) is also convergent. 

In this case series (3.121) is said to be absolutely convergent. Г Alem- 
bert’s and Cauchy’s tests retain their validity for complex series. 
The theorem on rearrangement of the terms of a series and the rule 
for term by term multiplication of series can be carried over of abso- 
lutely convergent complex series. All the theorems on absolutely 
convergent real series retain their validity for absolutely convergent 
complex series. 
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Functions of a complex variable. If, for every value of a complex 
variable z from a domain Z in the complex plane, there is a corres- 
ponding single value of another complex variable w=u+ iv, wis called 
a complex function of z in the domain Z and we write 


и = f(z). (3.126) 


If the function f(z) is expressible by a Taylor series in the neighbour- 
hood of the point z,, i.c. can be expanded as a convergent power 
series in powers of (z— zy), it is called an analytic function of z at the 
point 20. If f(z) is expressible as a power series in the neighbourhood 
of any point of the domain Z (open or closed), it is said to be an 
analytic function of z in the domain Z. Functions having this property 
are of the greatest interest in applied mathematics. 
The complex power series 


У e(z— zo" (3.127) 
n=0 
has a number of properties similar to those of real power series. 
We can consider in future, without loss of generality, the series 


Y ez. (3.128) 
n=0 

Since this series has a circle of convergence instead of an interval 
of convergence, the term radius of convergence acquires a strict mean- 
ing here. 

If the coefficients c, of power series (3.127) are real numbers, the 
radius R of the circle of convergence coincides with the previous 
radius of convergence. 

The foliowing proposition holds: if the series (3.128) is convergent 
at some point 2, of the circumference |2|= К, then as the point z 
approaches the point z, from inside the circle along a radius, we have 


lim Y ez = Y cz. 
2—20 n=O n=0 N 
A complex power series can be differentiated term by term inside 
its circle of convergence. 
If a function is expanded, as a series in powers of z, the distance 
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from the origin (2 = 0) to the nearest singulart point of the function 
is equal to the radius of convergence of the sum of the series. 


EXAMPLE 34. 
l раро — |728 = $ (рур 
==! 22+ 24-784 .., + (— Dz rU yz, 
(3.129) 
If we take the real axis z — x, the expansion 
Бе ы. 24 x4. x 
me! x*Lx*5—x"-o-... (3.130) 


has a radius of convergence R = 1, although the function 1/(1-- x?) 
and its derivatives have no discontinuities on passing through the 
points 4-1. On returning to expansion (3.129) in the complex plane, 
we see that the function 1/(1--z?) has discontinuities at the points 
+i. This is in fact the reason for the divergence of expansion (3.130) 
for |x| — 1. 

If we introduce the notation c, = а, 4-ib,, (am bn are real numbers), 
|z| = г, arg z = б, series (3.128) can be written in the form: 


= oo р 
У си" = Y (an +)" = 
n-0 n=0 


= Ў „а, + ,)(соѕ ид +i sin nO) = 


n-0 


=; 5 r"(a, cos пб — b, sin n0) +i у (Б, cos ид + a, sin n). 


nO nag 
Further, we have, on writing apr” = A,, —d,r" = B,: 
У с" = У (4, cos n8 + B sinnB) +i У, (— В„созпб + Ansin n). 
n=0 nad nap 


The real and imaginary parts of the series are thus written as trigono- 
metric series. 


ТА singular point is one in the neighbourhood of which a function is not 
expressible as a power series. 
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EXAMPLE 35, 


= Ў ("= |2|< 1); 


T. 1 _ l-rcos8 d 
1-2  i1-—(rcosÓlirsinü) 1—2rcos@+r? 


. rsin „= ZEN 
Wipro En uda cos KO HID T sin Аб, 


from which it follows that 


1—rcos0 2a 

ico cupi pn ORAN, 
r sino n 

I-2rcosóxri^ P sin КӨ. 


5. Trigonometric Fourier series 


A function f(x) having a period 2nt (f(x) — f(x -- 22), n= +1, +2,..) 
can be expressed, under certain restrictions to be described below, 
as an infinite trigonometric Fourier series 


Л) ~ E + Y. (a, cos nx + by sin nx). (3.131) 
n=l 


The Euler—Fourier formulae are used to find the coefficients of 
series (3.131): . 


a, = = F(x) cos nx dx (п = 0, 1,-2, ...), 
+ n 
= |" Ло ^ (2123.2 


(3.132) 


In order that the Fourier series (3.131) be convergent to the given 
function f(x), i.e. for its sum to be equal, at every point x, of the 
interval (0, 2л), to the value f(x;) at this point, the function f(x) 
must satisfy certain conditions (see below, and Chapter IV, 82, sec. 5). 


T If the period of f(x) is equal to 2L, it can be transformed to the period 2x 
by bringing in the variable у=лх/Г, so that all subsequent discussions retain 
their generality 
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THEOREM 13 (Localization theorem). The behaviour (i.e. converg- 
ence or divergence) of the Fourier series of the function f(x) at some 
point ху depends exclusively on the values taken by the function in the 
immediate vicinity of the point xo. 

The sum Sp of the series (3.131) for f(x) at x, is determined as 
follows: 

(a) when f(x) is continuous at xy, we have 


So = Д); 


(b) when f(x) has а discontinuity of the first kind at x, (so that 
the limits f(x)+0) and /(xy —0) exist), we have 


5, fes EO fes 0) 
фет ANE 


We say that f(x) is smooth in the segment [a, 5] if it has a conti- 
nuous derivative in this segment. 

A continuous function /(x) is described as piecewise smooth in 
the segment [a, 5] if the segment can be split into a finite number 
of subsegments, on each of which f(x) is smooth. 

A discontinuous f(x) is described as piecewise smooth on the seg- 
ment [a, 5] if: (1) it has only points of discontinuity of the first kind 
(and only a finite number of these) on the segment, (2) on each of the 
subsegments (х, В] into which the original segment is split by the 
points of discontinuity, the continuous function 


К+0) for х=а, 
a(x) = 4 f(x) for а= х < В, 
A-Q for х= В 
is piecewise smooth. 

A convergence test for Fourier series. The Fourier series of a piece- 
wise smooth (continuous or discontinuous) function f(x) of period 2л 
is convergent for all values of ху, its sum being equal to Sy. 

If а piecewise smooth function f(x) is continuous everywhere, its 
Fourier series is absolutely and uniformly convergent. 

THEOREM 14. Let f(x) be an absolutely integrable function of period 
2m, continuous and possessing an absolutely integrable derivative in 
some segment |a, b] (the derivative may cease to exist at individual 
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points). The Fourier series is then uniformly convergent to f(x) in 
every segment [a+6, b—6] (6>0). 

This theorem holds, in particular, for an absolutely integrable 
f(x) of period 2л, continuous and piecewise smooth on the segment 
[а, b]. 


EXAMPLE 36. The function f(x) = —1n|2 sinc ‚ Which becomes 


infinite for x —2kz (К = 0, +1, +2, ...), has period 2л. Its Fourier 
series is 
соѕ 2х соѕ 3x 


—~In 5 de 


ВИ 5 
21 = cosx+ 


THE DIRICHLET—JORDAN TEST. The Fourier series of а function 
f(x) is convergent at хо to the sum Sy if the function is of bounded 
variation in some segment [xy—46, Xo+ 4]. 

A more specialized statement is: 

DIRICHLET’s Test. If f(x) of period 2л is piecewise monotonic 
on a segment [—, x] and has a finite number of discontinuities there, 
then its Fourier series is convergent to the sum хо) at every point 


of continuity and to the sum Sy => [f(xo--0) - f(x, —0)] at every 


point of discontinuity (see Chapter IV, 8 2, sec. 5). 
Dint’s Test. The Fourier series of a function f(x) is convergent at 
а point хо to the sum Sy if, given some h > 0, the integral 


ji Ie( j 
1 


0 
exists, where 


Ф@) = fot 0) t fixo — 0— 250. 
The following is a particular case of Dini's test: 
LiPSCHITZ'S TEST. The Fourier series of a function f(x) is conver- 
gent at a point xy which it is continuous to the sum Sy = f(xo) if, 
given sufficiently small {> 0, 


По dE t) — feo) | = Ма, 


where L and « are positive constants (х = 1). 
In particular, piecewise differentiable functions are suited to this 
test. 
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The Dini and Dirichlet-Jordan tests are not consequences of one 
another. ] 

In the case of a function f(x), only specified on the semi-interval 
(—л, л), or defined outside it but non-periodic, application of the 
above theory is made possible by replacing f(x) by an auxiliary func- 
tion f*(x), having the following properties: 

F = Дх), (=r < хл), 
1*(-») = ўа), 
while f*(x) is extended to the remaining real values of х іп accordance 
with the law of periodicity. 

All the above theorems and propositions are applicable to the 
function f*(x). The series represents the function f(x) inside the inter- 
val. 

This construction is not required if f(—3) = Кл). In this case 
the Fourier series is convergent to f(x) throughout the open interval 
(excluding the ends). But outside the interval, the sum of the series 
in general no longer coincides with f(x), assuming the latter is defined 
throughout the real axis. 

On bearing in mind the footnote at the start of the present section, 
we can say that a function specified in any manner in any interval 
can be expanded as a trigonometric series in a very wide class of cases 
(this includes piecewise differentiable and piecewise monotonic 
functions) (see also Chapter IV, 8 2, sec. 5). 

Expansions in sines only or cosines only. The Fourier series of an 
even function f(x) 2(f(—x)) contains cosines only: 


Ах) ~ 20 у 3 ал COS пх. 
2 п 


The Fourier series of an odd function (f(x) = —f(—x)) contains 
sines only: 


Дх) ~ рх b, sin nx. 


Every function f(x), specified in the segment [—z, л], can be written 
as the sum of an even function Д(х) and an odd function f(x): 


f(x) = ЛО) +, 
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where the component functions are 


ЛО? .IOA-9, A) а) 


ера. 

If a function is only specified in the segment [0, л], we can define 
it arbitrarily in the interval [-—л, 0] and thus obtain different Fourier 
series, which will have а sum S, at a point x, between 0 and x, the sum 


being convergent either to f(x9) or to Uf H0) +f(x9—9)] (in the 


case of a discontinuity). 

If we complete the definition of the function in (—2, 0) as an even 
function, i.e. put f(— x) — f(x), we get an expansion in cosines only; 
and if we complete it as an odd function (f(—x) = —Кх)), we get 
an expansion in sines only. 

EXAMPLE 37. f(x) = x (0m x & m). 

(1) Let f(x) = -x)= -х(-пах< 0); then 


п 4 cos3x | cos5x 
лә = $7 e [ms t ss). 


(2) Let f(x) = —f(—x) = x (~r < x = 0); then 


sinx sin2x sin3x 
fle) = (Fre t- e): 


The order of the Fourier coefficients. If a periodic function f(x) has 
a finite number of discontinuities of the first kind (in a period), 
its Fourier coefficients will be infinitesimals of the form O(1/n) as 
п — œ (see Chapter 1, $ 3, sec. 8 and 15). 

This means that 


п|а„|< М, n|5b,] = М, 


where M is a constant positive number independent of п. 

If the periodic function f(x) is continuous everywhere, its Fourier 
coefficients will be infinitesimals of higher order than 1/n as n + ee, 
ie. of the form o(1/n) (see Chapter І, $ 3, sec. 8 and 15). 

This means that 


lim na, = lim nb, = 0. 
п оо n> оо 
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If a periodic continuous function has continuous derivatives every- 
where up to and including the (m— 1)th order, its Fourier coefficients 
а, and Б, will be of higher order than 1/n™ as n — =, i.e. 

lim n™a, = lim n™b, = 0. 
п» оо п> оо 

In particular, if a periodic function f(x) has continuous derivatives 
of any order everywhere, its Fourier coefficients a, and b, satisfy 
the condition 

n™a, — 0, n™b, +0 
as п-> <, independently of т. 

Integration of Fourier series. Let us first consider a continuous 
function f(x), specified everywhere on Ё,. 

THEOREM 15. Jf an absolutely integrable function f(x) is specified 
by its Fourier series: 


Дх) ~ z E (a, cos nx 4- b, sin nx), (3.133) 


b : 

we can find | Лх) dx by term by term integration of series (3.133), 
а 

independently of whether the latter is convergent or not, i.e. 


a,(sin nb — sin na) — b,(cos nb — cos na) 
A + 


b 5 
f /0дах = 2(b-a)+ Y 
à 2 P 
(3.134) 

THEOREM 16. Let an absolutely integrable function be specified 


by its Fourier series (3.133) (convergent or not). The following 
Fourier expansion now holds for its integral: 


$ Sb & — b, cos nx + (a, + (— 1)%1а,) sin nx 
ах = Zn ЕЕ саран ВРА ту. БЕЛА ORG GS Ad Жезнай: шы 
| foe = а í 
(-л= x < n). (3.135) 


A particular case of this theorem is when а, = 0 (the other condi- 
tions are retained); we now have for all x: 


[жов 2 > bn в $ — b, cos nx + a, sin nx . (139 
б = 


1" п п 
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Differentiation of Fourier series. 


THEOREM 17. Let f(x) be a continuous function of period 2л, possess- 
ing an absolutely integrable derivative ( which may not exist at a finite 
number of points). The Fourier series for f'(x) can now be obtained 
from the Fourier series (3.133) for f(x) by term by term differentiation: 


Го) ~ У n(b, cos nx — a, sin nx). (3.137) 
n=l 
THEOREM 18. Let f(x) bea continuous function of period 2л, possess- 
ing m derivatives, the first m—1 derivatives being continuous, and 
the m-th absolutely integrable (the m-th m-ay cease to exist at a finite 
number of points). Now: (1) The Fourier series of all m derivatives 
can be obtained by term by term differentiation of the Fourier series 
for f(x), all these series, except possibly the last, being convergent 
to the corresponding derivative; (2) the following relationships hold 
for the Fourier coefficients of f(x) (see above): 
lim "Та, = lim п", = 0. (3.138) 
no оо Lis dod 
The series for f(x) and all the series obtained from it by term by 
term differentiation (except possibly the last) are uniformly convergent 
in this case. ; 
This theorem has the following converse. 
THEOREM 19. Given the trigonometric series 


+ У (a, cos nx +b sin nx), (3.139) 
n=l 


if the following relationships hold for the coefficients a, and b,, 
jn™a,| = М, [n"b,| = M(m = 2, М = const), 


then the sum of the series is a continuous function of period 2л, pos- 
sessing т — 2 continuous derivatives, which may be obtained by term 
by term differentiation. 

THEOREM 20. Let f(x) be a continuous function specified on the 
segment [-л, п] and having an absolutely integrable derivative (which 
may cease, to exist at a finite number of points). Then 


Го) ~ 5 + > [nbn + (— D^c) cos mx — na, sin nx], (3.140) 
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where a, and b, are the Fourier coefficients of f(x), while the constant 
с is given by the equation 


1 
c = H-A). (3.141) 
THEOREM 21. Given the series 
Z+ У (a, cos nx +b, sin nx), (3.142) 
n=l 


if the series 
5 + ў [(nb, + (— 1)" с} cos nx — na, sin nx], (3.143) 
n=1 


where 
c= lim [(— 1)**! nb,], (3.144) 


п> ое 


is the Fourier series of an absolutely integrable function g(x)f, 
x 

then the series (3.142) is the Fourier series of f(x) -| ф(х) dx + 
оо 0 

tpe У а, continuous for —п = х = п, and is convergent 
nel] 

to this function, while obviously f'(x) = ф(х) at all the points of 

continuity of ¢(x). 

THEOREM 22. Given the series 


2+. (— 1)" (a, cos nx + b, sin nx), (3.145) 


where a, and b, are positive, if na,, nb, do not increase (as from a 
certain n) and tend to zero as n ~ «o, the series is convergent for 
—л < х = mand has a differentiable sum f(x), where 


fio = (— Пти, cos nx— a, sin nx), 


i.e. series (3.145) can be differentiated term by term. 

Similar theorems can be stated for functions specified on the seg- 
ment [0, л] (see for example ref. 10). 

Further information on trigonometric series will be found in 
Chapter IV. 


+ We do not assume the convergence of series (3.143). 
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6. Asymptotic series 


If a function F(x), defined for x = Хо, is to be considered for large 
values of the argument x, it is sometimes useful to find a function 
S(x) of simple structure such that 

К(х) = F(x)—-S(x)-0 as x= æ, 


In this case F(x) can be replaced by S(x) for large x. If F(x) admits 
of the expansion (for x> xj): 


ГА A, А 2 А 
Ро) = dott Натан t= У 5, 6146 
we find, on putting 
„луу Ак йу An 
Sq) = ao = А+... + (3.147) 
апа 
е А 
R(x) = F(x) -s(x = e em - dba ... (3.148) 
an+ 
that 


lim x"R,(x)=0, or А (х) =о (=) 3 (3.149) 
т ео х 
іе. R,(x) is an infinitesimal of higher order than п. 

If F(x) does not admit of an expansion (3-146), it is still sometimes 
possible to choose a series of the form (3.146) such that condition 
(3.149) is satisfied for any fixed л. 

Series (3.147) is said to be asymptotic for F(x), and we write 

= А 
Ех ~ У =k 


ae (3.150) 


Series (3.147) can be divergent, but it is still useful since it yields 
the approximate formulae 


FQ) = = Ayr 2 


+ + 


the degree of the approximation being indicated by (3.149). 
EXAMPLE 38. Let us consider the function 


Ро) [e$ 
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Repeated integration by parts gives: 


1 2! g em Di 
Ех) = ou +В, 
where 
оо e 
R(x) = "- pu dt, 
x 
oo et et [== со ех 1 
| pid = ит ео [Г pu d ug: 
x tex 
consequently, 
[А (х) | = E 


and condition (3.149) is satisfied. Thus 


This series is divergent, since 

lim a, = lim (— pp Org 
n—> со п —> со 

If F(x) admits of ап asymptotic expansion, this latter is unique. 

The asymptotic expansion of the product of two functions F(x) 


and G(x), each of which has an asymptotic expansion 


oo. 


FQ) ~ У Аах Оо) У Вх, (3.151) 
h-0 k=0 ` 
is formally equal to the product of asymptotic expansions (3.151): 
FOG) ~ Y Ayx-^ Y Вух-® = Y Cyr, (3.152) 
к=0 &=0 к=0 


where 
m 
Ст = У ApBm-r (3.153) 
k=0 
If the asymptotic expansion (3.150) of F(x) starts with the term 
Ax™?, it can be formally integrated term by term in the interval 
from x to + e, i.e. 


[реа p Е Ак = ў er 


k=2 
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Formal differentiation of asymptotic expansion is not permissible. 
If F(x) has an asymptotic expansion with no free term (А, = 0 and 
F(x) — 0 as x — eo), this expansion can be exponentiated 


eF@) = рф Y — [FG] ~ 
mzi M: 


А, EU A, |1 
ELE gates: (3.154) 


The asymptotic expansion is thus a source of approximate formulae 
for computing a function for large values of its argument, the acc- 
uracy of formula (3.147) being the greater, the greater the value of 
the argument. 

There exist functions, not identically zero, for which all the coeffi- 
cients A, in the asymptotic form (3.150) are equal to zero. Such 
functions are described as asymptotic zeros. An asymptotic zero is 
any function F(x), for which 


1 
F(x) = О (>) 


for any n. For example, F(x) = e~* is an asymptotic zero. Addition 
of this function to the left-hand side of (3.150) does not change its 
right-hand side. 

Not every function F(x), defined in the semi-interval [a, + e], 
admits of an asymptotic expansion (3.150), but if such an expansion 
exists, it is unique for the given F(x) (the coefficients are uniquely 
defined). On the other hand, there exists for any sequence of numbers 
{4,} a function F(x), for which the 4, are the coefficients of an 
asymptotic expansion (3.150). This F(x) is not uniquely defined, 
however (to an accuracy of an asymptotic zero). 


7. Some methods of generalized summation of divergent series 


Certain classes of divergent series, i.e. series lacking a sum in the 
ordinary sense of the word, are capable of generalized summation. 

The definition of generalized sum usually satisfies two condi- 
tions: 

1°. The linearity condition. If the generalized sum A corresponds 
to the series J a,, and the generalized sum В to Y b,, the series 
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У(ра,-+46,), where p and q are arbitrary constants, must have a 
generalized sum equal to pA--qB. 

2*. The permanence condition. 1f a series is convergent in the 
ordinary sense to the sum А, it must also have a generalized sum, 
equal to A. 

The general plan for constructing linear permanent methods of 
summation is as follows. 

Let 

Yox), ri), see Уп(х), ы (3.155) 


be a sequence of functions given in a domain X of variation of the 
parameter x, and let X have a point of condensation — the finite or 
improper number o. 

We construct, in accordance with the numerical series 


n ал, (3.156) 
n-0 
the functional series 
У а(х). - (3.157) 
nx0 


If this series is convergent, at least for x sufficiently close to c, 
and its sum S(x) tends to a limit 4 as x -- (о, this number А is in 
fact taken as the generalized sum of series (3.156). To ensure that 
the method has permanence, two conditions are imposed on the 
functions y,(x): 


а) lim у(х) = 1 — (т=0,1,2,...); (3.158) 
(2) for all x € X: 
[y+ Ў Г) уп я Km (K= const). (3159 


We shall next consider two methods of generalized summation, 
embraced by the general plan just described. 

1°. The method of power series (Poisson). In accordance with the 
given numerical series (3.156), we form the power series 


У ax" = в+ах+... ++ ...; (3.160) 


neo 
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if this series is convergent in the interval 0 = x = 1 anditssum S(x) 
has the limit 4 as x > 1: 


lim S(x) = 4, 


n-r 1—0 


the number А is called the generalized sum (in Poisson’s sense) of 
the given series (3.156). 
This method follows from the general scheme if we put 


IX = (0, 1), @=1, (х) = х" (п = 0, 1, 2, ...).: 
EXAMPLE 39. Let из take the series discussed by Euler: 
1—1+1-—1+1-1+.... (3.161) 


It has no sum in the ordinary sense, since s, oscillates between 0 and 
+1. The corresponding power series (3.160) has the form 


1=х+х2-- х3 хі х5... = Y (—1)"х". 
Tw0 


For 0< x <1, itssum (asthe sum of an infinite geometrical pro- 
gression) is equal to 


509 = = ; (3.162) 


the generalized sum in Poisson’s sense of series (3.161) is 
1 1 
А = Ш ——-2-—. 3.163 
х->1-о1+Х 2 ( ) 
EXAMPLE 40. The series 
у sin пб (-п=0=л) (3.164) 
n=l 
is convergent only for 0 = 0 and 0 = +x. The corresponding 
power series 
У x^ sin пб (3.165) 


n=l 
has the sum, for 0 - x « 1: 


x sin 


$0) = 1-2xcos0-- x? ' 
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The generalized sum is thus equal to 


A= lim po NS P sing = Ls = L estes 
^ асо 1 2х сове рх — 2(1—cos0) 2 27 
(3.166) 


2°. The method of arithmetic means (Cesàro). We take the partial 
sums 5, of the given numerical series (3.156): 
50 = @, $ = Ata, 


п (3.167) 
52 = @ {а +45, ..., 5 = Y аһ 


and form their consecutive arithmetic means: 


Sot Sy | А A, а ке t$ (3.168) 


A=% А4 = 5 p m 


If the sequence (4,) has a limit 4 as n — co, we call А the generalized 
sum (in Cesáro's sense) of series (3.156). 
This method follows from the general plan if we put 


jim fo m-0,1,...,n—l, 
X = п, 0 = +, уһ(п) = n 
| 0 fo т=п. 


EXAMPLE 41. Let us return to series (3.164). When р # 0: 


cos +6 — cos (» +7) 


2 
Sn = 1 › 
2sin 50 
E Z cotan 49- ша i ‚ 
4 sin? > 6 


: 1 8 
А = lin 4, = —cotan. 
We have thus obtained a generalized sum in Cesàro's sense equal 
to the generalized sum in Poisson's sense. 
The inter-relationship between the Cesàro and Poisson methods 
may be explained by quoting the following theorem: 
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THEOREM 23. (Frobenius). Jf a series is summable in accordance 
with the method of arithmetic means to the finite “sum” A, it is simul- 
taneously summable by the method of power series, to the same sum A. 

Notice that Poisson’s method is applicable to a wider class of 
series than Cesaro’s method, though it does not contradict Cesaro’s 
method when both are applicable. 


§ 3. Methods of calculating the sum of a series 


We shall discuss in this section some methods of finite summation 
of series, some estimates for series, finite sums and products, and 
the problem, of importance for practical computation, of improving 
the convergence of series, i.e. methods enabling a given series іо be 
replaced by another, having the same sum but more rapidly con- 
vergent. 


1. Elementary methods of exact summation 


It is very rarely possible to sum exactly an infinite series obtained 
as a result of solving some problem. Some simple methods of strict 
finite summation are given below. 


THEOREM 24. If the terms a, of the series У a, can be written 


n=l 
in the form a, = b,—b,,, and if the b, form a sequence {b,} having 
a limit a, the sum of the series is 


S= Ya = b-a. (3.169) 


n=0 


EXAMPLE 42. Suppose we have the series 


оо 1 А 

рур): 
VETE ТЕТ. 
Jant i(n +n) уп +!” 


and lim 1/Vn = 0, so that S = 1 (bg = = 1). 


%— оо 


һеге 


SERIES 147 


THEOREM 25. If the terms of the series У a, are expressible as 
n=0 


an = буу Наина +... аррар (3.170) 


where p is some fixed positive integer = 2, b, form a sequence having 
a limit a, and х; are numbers satisfying the condition 


a ++... +a, = 0, (3.171) 
the series т question is convergent, and its sum is equal to 
S = aby + (а +92) +... ++... арб + 
+ (ж +2 +34 +(р- Пара. (3.172) 
EXAMPLE 43. Given the series 


= 4n+6 
ay (л + 1) (0+2) (2 +3)’ 
we have 
4n+6 1 2 3 


(л + 1) (л + 2) (п+3) mel Иа ПЗ" 
Consequently, x, = 1, х = 2, аз = —3. 


Condition (3.171) is satisfied : 1+2-3 = 0. In addition, 5, = 
=1/п + 0 as n — oo, We now find, by (3.172): 


1 5 
$- 1140427 = 5. 


THEOREM 26. If the terms of the series у, a, can be written as 
n=0 


а = b, ZH [m 


where q is a positive integer, while the sequence of numbers by, bi, 
by... has a limit &, the sum of the series is 


S- = bo tht... +4. 1-94. 
пе 


Tables of series expansions of functions and the relevant sections 
of reference works may be used for the finite summation of series. 
Given a particular series, it should be verified whether or not it 
is to be found in a reference book, or whether it can be transformed 
to a familiar series by a change of variable or some other means. 
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EXAMPLE 44, Suppose we have the series 
У kp*sinkx, |р| < 1. 
ке 
We find ір ref. 7, formula 1.447 3, which we can write аз 


— п? 
Ig re ee р (lp = 1). 


1 
2 125рсозхірї 2 


The uniform convergence of this series and the series of the deriva- 
tives of its terms with respect to x follows from comparing them with 


the majorant series Y. |p]* and Y, k|p|* respectively. On differen- 
kel kel 


tiating both sides of the equation with respect to x, we find the sum 
of the series (see § 2, sec. 1): 


S LA рар) їп х 
P kp* sin kx = ev PR (ip]-« 1). 


2. Summation of series with the aid of functions of a complex 
variable 


И the trigonometric series 


A $ a, cosnx = ДО, (3.173) 
n=} 
Ў aq sinnx = f,(x) (3.174) 
n=l 


have positive coefficients а,, and the series У a,/n is convergent, 
nel 
(3.173) and (3.174) are the Fourier series of continuous functions. 
We can sometimes find the functions f(x) and /(х) — the sums 
of series (3.173) and (3.174) — by making use of functions of a 
complex variable. 
Let 


KS 
Ф(@ = ao У ам“ 
net 


be the sum ofa series convergent in the circle |z] < 1. If lim g(z)— 
]zi1 
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= lim gire”) = ф(е?), then AHi) = pén), i.e. after separating 


the real and imaginary parts of y(e*), we have: 
A(x) = Re {pi}; (3.175) 
Jax) = Im {p(e*)}. (3.176) 


EXAMPLE 45. Let us establish the convergence and sum of the 
series 


cosx cos 2x < COS их 
Таор ERE + mr? (3.177) 

sinx sin 2x се sin nx 

E 51 Кэз ap (3.178) 


The convergence of series (3.117) and (3.178) follows readily from 
a comparison with the series 


= 
bL US 
which is majorant for the given series. Furthermore, we put 
со 2% 
Ф) = 1н у — = её. 
nz] M: 


On expressing 2 in the exponential form z = ге and letting ғ tend 
to 1, we have 


ec == 6008 2+1 80 х — е008 сос (sin x) + i sin (sin x)] = 


E $ то ism лу 


, 


та 
€*95 = cos (sin x) + ie°°** sin (sin x)= 1+ 2, COST d X == Я 
n=l H 
Hence, 
14 X cos х = 0035 cos (sin x, (3.179) 
ney п! 
Y sin nx = g008* gin (sin X). (3.180) 


no, n 
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3. Summation of series with the aid of Laplace transforms 


Definition of the Laplace transform. Suppose that, given any x>0, 
the modulus of the function ф(х) increases more slowly than some 
exponential function i.e. there exist numbers M and so, not depending 
on x, Such that, for any x, 


{ф(х) | = Mest, (3.181) 
Let p = 5+іс be a complex number. The integral 
a(p) = | e~P*y(x) ах (3.182) 
о 


now exists and has derivatives of all orders іп the half-plane 
Кер > So. The integral (3.182) is called the Laplace transform of ф(х). 
In the accepted brief terminology, p(x) is the pre-image, and a(p) the 
image. 

Tables have been compiled for the pre-images and images of many 
functions (see for example ref. 7). 

Summation of numerical series (ref. 9). If, given the convergent 
infinite series 


S= > (+) *a(k) (3.183) 
=i 
its terms are images of a pre-image ф(Ё), i.e. 
alk) = E e-*g(e) de, 
0 


the following formula holds (preserving the correspondence of the 
t signs): 


T a * (р) dé 
2, CE Dat) = f EFI (3.184) 


EXAMPLE 46. Knowing that - 


a со 
—— = —hé gi 
бүг || е- sin a£ dé, 
уе һауе Бу (3.184): 
= 1 _ 1 (е епа xz л 
та = : "EROS ga 0tanh ла—-=. 
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Generating functions. If the terms of the sequence {f}(t)} (k = 1, 
2, 3, ...), defined in some interval х «1—f, are the coefficients or 
the Taylor expansion of a known function F(x, 1) in powers of x fof 
[х| < 1, ie. 

Ех, 0) = У х) (3.185) 

к= 
F(x,t) is called the generating function of the sequence {f,{t)}. For 
example, one of the following sequences can be taken as {№(1)}: 

(a) the sequence of powers f, t?, 13,..., where 


Ех, ) = = = x хый, (3.186) 


апа |xz| < 1; 
(b) the sequence of trigonometric functions 


sint, sin2t, sin3t ... 


or 
сов і, cos2t, со53/,... 
where 
= xsint ae E 
Е(х, 1) = T3 P x sin kt (3.187) 
and 
х сов t—x? > 
Fx, t) = хи = i^ cos kt. (3.188) 


where ¢ can vary in any interval and |x| < 1; 
(c) the sequence of Chebyshev polynomials T(x), T,(x), T), . .., 
for which the following relationship holds: 
аА) з 
F(x, t) = =ч“ р T(t): (3.189) 


where |ti = 1,]x| <1; 
(d) the sequence of Legendre polynomials P,(t), P(t), Р.(@),..., 
where 
1 


F(x, t) = ~ 
me Jx?—2xt+1 


-1= У хр, (3.190) 
k=l 


for |¢| = 1 and |x| = 1. 
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It should also be noticed that the infinite series (3.186)-(3.190) are 
convergent for x — + 1 or oscillate between finite limits (i.e. the 
sum of the first m terms remains less in absolute value than some 
constant independent of ¢ and т). 

The summation of functional series (ref. 9). Suppose that the 
generating function F(x, t) is known for an infinite sequence of 
functions [f,(t)) (k = 1, 2, 3,...) (see above). Let the series 


St, х)= 2: a(k)x* f(t) (3.191) 


be convergent in some intervale = t < Band for | x | & 1. If the coeffi- 
cients a(k) of series (3.191), considered as functions of the index 
k, are images of some (ё), we have for the sum of series (3.191): 


5а, х) = | 7 ME) Fore", 1) dt, (3.192) 
0 


ЕхАМРІЕ 47. Knowing that the fraction 1/(k +1) is an image of 
e~* for any / = 0 and k > 0, i.e. 


1 со 
— = — (+0 
k+l | á &, 


and using formulae (3.187), (3.188) and (3.192) for positive integral 
l, we have: 


= x sin kt 
Si, x) = Pay ara иш = 
1 ст — ]yn-i m 
- = У сор C5 (— 1) sin (r— Dt -- sin J _ 
mel m T» 
sin It xsint 
— E In (1 = 2x cos t +x?) +. cos [4 arctan EOD } Н (3.193) 


& xè cos kt 
Sine ye 
°( х) | k+l 


zx | y qot | 5 СТ(— 1)" соз (r— Dt — cos s|- 
mel r= 


cos It xsint 


od In (1 — 2x cos t+ x?) + sin lt arc tan ib ET b (3.194) 
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Formulae (3.193) and (3.194) remain valid for any t and |x| = 1, with 
the exception of points of discontinuity (ref. 11), which may make 
their appearance for the trigonometric series with x = +1. 

On making use of generating functions (3.186), (3.189), (3.190), as 
also (3.192) with positive integral /; summation formulae similar to 
3.193) and (3.194) can be established for the series 


eon = “АТ а x*p,(t) 
, and 
k=l +1 d. k+l eX k+l 


4. Integral estimations for finite sums and infinite series 


Euler’s formula. If a function a(x) has derivatives up to and in- 
cluding the nth order for m= x = k (mand К are positive integers), 
the following formula holds, due to Euler: 


А-1 R п-1 В 
У a(t) = | a(t)dt+ У, sr la? 0 — ат] - 
m ym) ^* 


tm 
ly S атт+1—)4@ 3.195 
ат | „0 а (e+1—t)dtt, (3.195) 
where У (1) = B,(t)—B,, B, are Bernoulli numbers, B,(t) are 


Bernoulli polynomials (see Chapter VI). 


First integral estimate. We suppose that a™ (x) = Ott in the interval 
q= х= р+1 (р апі дагероѕійуеіпіевегѕ). Let M, denote the greatest, 
and т, the least, value of Y,,(t) in the segment0 =1=1. The following 
inequality now holds: 


ssp +1, ф— аат pe) 2079] = Ў д) = 
x mi 
= sap +l, -T [g^ (q--1-a^-Xg), (3.196) 


t When п=1 we have to assume z (В, >!) (а®-(Ю-а®-И(т)]==0; in 


=1 
addition, it is assumed here and throughout what follows that f(x) = 19+ 
tt If a(x) a0, the inequality signs of (3.196) have to be reversed. 
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wheret 


Dl п-1 В 
пож d = [att ar erp nd 
ypm]l^* 


q 
Let us quote some values for M, and ти: 


$ 
T6’ 


It can be shown that 


M, =-=, m =0; М, ~ 0-0244582..., m, = —0-0244582.... 


Ма = Yx (2) > 0 and ти = 0, if 16 even 


2 
И we make the following assumptions: 


My =O and my- (5) <0, if Jis odd. 


(a) а(х) = 0 for д=х< о; 
(b) lim ах) 20 for m=0, 1, 2, ..., п- 1; 
g> оо 
(с) the integral | а(х) 2х is convergent, 
q 
we now get, by (3.196), as p — =: 


М, 
Sn (+=, + аг q'n7? (q) = 


= b alk) = (+ oo, 9) +7 a™-V(q), (3.197) 

=q ! 

where 
со п-1 B 
Syr œ, q) = | a(t) dt — x T ag). 


q 
EXAMPLE 48. Knowing that the derivatives of any order of a(x) = 
=] Nx.: аге sign-definite in 1 = х = 101, we can estimate the sum 


by making use of (3-196). 
Be aw- (р+1)-—а——10)] =0. 


n-1 
+ When n=1, we have to assume У m 


Pal 
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We have, for instance, 
18.1 = 5 = 19 -for n=l; 
18.55 < S < 18-61 for n22; 
18.5890 < 5 < 18-5909 for п=б. 


Second integral estimate. If we assume that (—1)"-* 22" (x) = Oft 
for q = х= р+1, the following inequality holds: 


B 
Samp +1, 9) + Ол! [42т-0(р+1)-а"-(4)] = 


р 
= È а = зт-(р+1, Ф, (3.198) 
=q 
where 
Dl 2m-3 В, 
т-р +1, 4) -| «t)dt-- Y. Spa D a7. 
4 ‚1° 


И we assume: 


(a) (—– 1)"-100т(х) = 0ї for gqax<+o 
(b) lim qQ&-3(x) 20 for Е=Ь2,..., т; 
x—> со 


` (c) integral | a(x) dx is convergent, 
9 
the following holds: 


Samal =, D- Ee dm) = Ў a) = sa Cms 9, 
(3.199) 


where 
о 2m-2 В 
(+= 9) = [ adi У зад) т, 
q "= ` 
EXAMPLE 49. Knowing that, with a(x) = x72, the following 
condition holds: (— 1)* а! (х) > 0 for all x > 0, we can carry out 
an estimate of the sum Е 


109 
$ = У дат, 
к= 


HIF (—1)”—1а@"®%(х) = 0, the signs of inequalities (3.198) and (3.199) must 
be reversed. 
2m-2 
tt When m=1, we have to put X (B,/»!)a'*7?(g) = Byala). 


vel 
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by making use of inequality (3.198) with m — 2. We have 
40501-2260 = S < 40501-2265. 


The first and second integral estimates may be used not only 
for evaluating finite sums and infinite series, but also for evaluating 
finite and infinite products. 

EXAMPLE 50. Let us estimate the size of the product Р = pl. 


р 
On taking logarithms, we have 5 = In P — У Ink. 
ke 
Notice that the following conditions are satisfied for the function 


a(x) = In x in the interval 7S xsp+1: 


а(х) = i. 0, а(х) = -4< 0 and 2'(х) = E > 0. 


On using (3.196), say with и = 3, we get 


ар D- 3519 D- a") sin? s 


= 5(р+1, 433 р-а") (3.200) 
where 


spl 1) = GEL 


On exponentiating inequality (3.200), we finally get 


.Ys @+р)р Үз (3+р)р 
Lye 218 (р+1)? =p! = Lt (р+1)? ; 


where 
1 1 
L= (py а аро] 


We next consider transformation of series for improving their 
convergence. 
5. Kummer’s transformation 


Suppose we have the series with positive terms: 


Rn = Ў as (3.201) 
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and some auxiliary series 
Bm = У bp (3.202) 
=m 


which is convergent and has a finite sum Ви. Suppose the finite limit 
exists: 
b, 


А = lim — #0. (3.203) 
п> оо In 
In these circumstances series (3.201) is convergent (see Test Ш, $ 1) 
and the following identity holds: 
Ваа 1 5, | 
Ry = Pm. y (1-2 e)a (3.204) 


nm 


which is known as Kummer’s transformation for the series (3.201)- 


6. Improvement of the convergence of series corresponding to a 
given convergence test 


Transformation (3.204) can be used for improving the conver- 
gence of series (3.201). For, by (3.204), the convergence of (3.201) 
will be improved in the sense that the general term а@)= 
- (1-3 nlan) Jan of the transformed series У а will tend 

пат 
to zero faster than a,, і.е. lim аа, = 0. Obviously, the faster 


>> 


the ratio b,/a, tends to its finite limit А ғ 0, the faster the series 
on the right-hand side of (3.204) will converge. 

Transformation (3.204) can be applied several times in succession 
to the same series (3.201). 

Suppose, for example, that the terms of the auxiliary series 


B® у bp (Е = 0, 1, 2, ..., р) 


nem 


are chosen successively so that 
(1) the sum B® (k = 1, 2, ..., р) is already known to us; 


(2) 4, = lim A9, where 49 = 2 aton „ (1-4) um 
kc m Ano waere п = gga? № т Aye an 


all the 4, being bounded and non-zero. 


158 MATHEMATICAL ANALYSIS 


Now, on putting А®/А, = 1—80, where lim £(P = 0, we have 
after the pth transformation of (3.201): сг 


Ree ey араб, (3.205) 
hw0 En nmm kmo 


_ It occasionally turns out that all the e(P = 0 for a certain k, 
and we get the strict sum of series (3.201). 
Every transformation of type (3.204) is determined by the choice 


of some series È, b,, which corresponds to some test which is sufficient 
nel = 
for the convergence of the series } a,, obtained from Test Ш. We can 
nel 
say in this sense that, for every convergence test following from Test 


ПІ, there is a corresponding method of improving the convergence 
of the series. It may prove convenient in practice to take all the 5(9), 
ЫШ, 5%, ... equal or different in transformations (3.205), i.e. 
to choose the stages in the improvement of the convergence in accord- 
ance with the convergence obtained by using different tests. We 
shall consider below, as an example of the application of transfor- 
mation (3.205), methods of improving the convergence of series 
corresponding to d’Alembert’s and Gauss’s tests. 

Improvement of the convergence of series corresponding to d’ Alembert’s 
test. We put in identity (3.204): b, = a,,,—a, = Ла, and take 


the series У a, to be convergent by d'Alembert's test, i.e 


n=1 
lim ZH =p <1 
n—9 Un 
Let o > 0; then 
> а > Да 
„= Ў a= а $ СЗ! (3.206) 
nem 0 nem 0 
where 
A= lim des. 
N> оо an 


On again applying transformation (3.206) to the series 


ee 4a 
Y aM, where a = d — 
nem 0 
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we have 


The following notation is used here: 


14 Ba, 4 4 
e (qian e = (1-4) (1-2) 


Thus, р successive applications of the above transformation to the 
original series give (using the above notation): 


umm sm) 
where 
А-1 
dan al (1-3) 
Ay = lim [* and 4, = lim EL 8 : 
n— o Яп п> оо Е 
(a) 


(Е = 1, 2, 3, ..., p). 
Euler's transformation. Given the power series 
Y a,x" (3.208) 
net 
suppose that the following conditions are satisfied; 


Акъ; 


lim H „1+ and lim = 1 (3.209) 


n— 9 Xn noo 


(kK = 1, 2, ..., р). 


f This guarantees the convergence of series (3.208) with |x|<1 (see ref. 
11, vol. П). 
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We can now apply to series (3.208) the transformation (3.207), which 
reduces to the following familiar Euler transformation: 


оо a 0X pol А x \#+1 
У вх" = $214 a ( a + 


FA 1-x 


tcl Ў (Аға ух", (3.210) 


EXAMPLE 51. Let «, = Р(п) be a polynomial of degree т; it is 
easily verified that conditions (3.209) are satisfied here for all k = m, 
while we have in addition A*x, = 0 for any k > т. Now, on applying 
(3.210), we obtain, for |х| < 1: 
> _ Ра)х & 4 x үт 
У Р(п)х® = aa ed :Р(1) i= é 


па 1 
Improvement of the convergence of series corresponding to Gauss’s 


> 
test. Suppose that the series У a, is convergent where the conditions 
nam 
of Gauss’s test are satisfied, i.e. 


амы _ + pyr + (п) 
a, +g + y(n)’ 
where ф(п) and y(n) have orders lower than и 


qı—pı > 1 (see $ 1, sec. 5). 
If we put b, = (n+1)a,,,—na,, transformation (3.204) can be 


А-1, and in addition, 


applied to the series У a,. We have 
nem 
= más, 
аһ = LÁ 
P» ^" G-n-l 
1 S ртр 2+... +рь 


шылыш , G2 
n- a-l kn mug... ‹ ) 


+ 
Where pi, Py ..., ру are certain new coefficients not dependent 
on п. Transformation (3.204) for the series (3.211) can be repeated. 
EXAMPLE 52. If transformation (3.211) is applied twice to the 
Series 
= 1 


s= 2, n(n+1) 
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we get 

2 1 
5 = —+6 ————Á—À—— a. 
ЕСС 


If we take into account only three terms of the last series, we get 
S x 59/60, while the exact sum is S = 1. 
EXAMPLE 53. Given the series 


S= a (3.212) 
nam 
where 
= з 
mod (FOTO а x B—y <0, 


=o (k +1) (x +k) 


we can apply transformation (3.211) several times. We obtain after 
p transformations of the series (3.212): 


2828 
E ура) + 
aB P È  (у+з—)(у+5—8) 
tiyap) уш és ООО +51 В) 
(y-s—2)(yts—B) г an 
EA A S ы a 
ж с o m аар) 


$-0 


+ 


7. Abel’s transformation 


The identity 


p [1 - ИА +F 2: (аһ — 4 41) By, (3.213) 


where B, — È B, is called Abel's transformation. It is the analogue ` 


of the fondu for integration by parts of finite sums. On letting 
К + «in (3.213), we arrive at infinite sequences (x,) and {В,}. 
It follows from (3.213), и {Bp} is bounded and lima, = 0, that 


k—> o 


PEL (3214) 
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This transformation can be utilized for improving the convergence 
of infinite series (see ref. 1). 
EXAMPLE 54. Let us improve the convergence of the trigonometric 


series 
Yiu, sinkx and У wcoskx, where limu, = 0, 
к=1 het 


with the knowledge that 


1 
h is Р cos (ei) 
у Би Іх == pi cot 7 КЕТЕ? 
wal 2sin— 
2 
and 
» sin (++!) 
=} 2 sin 


On using transformation (3.214) after putting а = uy, du, = 
= Uy, Ид, We get: 


i uy cot 1 m 1 
Y, sin kx = + У duy cos| К+ |х; 
k=l 2 2 sin: k=l 2 

2 (3.215) 


Y uy cos kx = EL i У Au, sin kd. x. (3.216) 

REL 2 25 X k=l 2 
sin = 
2 
Obviously, these transformations of trigonometric series can 
conveniently be employed in the case when the и, tend to zero slowly 
and lim Zu,/u, = 0. The improvement in the convergence will be 


А œ 
the greater, the faster 4u,/u, tends to zero. 
If transformation (3.214) is applied a second time to series (3.215) 
and (3.216), we get 
Ў up Sin kx = (u—2) cot 2 : У 22и, sin (k+ 1)x 
hey 2 2 4 sin? X k=l 
in? > 
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and 
cos x 


Y uy COS kx = — (s - из) x mH Au, cos (k + 1)x, 


hel 4 sin? 
Sin^ — 
2 


where 4?u, = и, ,4—2u, ,,- uy is a difference of the second order. 
For instance, if и, = 1/k, we have du, = 1/k(k-- 1), 


Au, = 2/k(k+1) (k 4-2), etc. 


8. A. N. Krylovs method of improving the convergence of 
trigonometric series 


If f(x) satisfies Dirichlet’s conditions, it can be expanded as a 
convergent Fourier series: 


Дх) = a+ Y (a4 cos nx + b, sin nx), (3217) 
=з 


where the Fourier coefficients a, and 5, are of order 1/п if f(x) 
is a function of bounded variation. Such a series is slowly convergent. 
It is possible to speed up the convergence by isolating the slowly 
convergent part. Let Хх) have bounded derivatives of the kth order 
everywhere except for a finite number of points x1, x0), ..., x{0). 
At these points f(x) has a discontinuity of the first kind, the size of 
the jump A, being equal to 
һ = Хх 4-0) — Дх® -- 0) (i= 1, 2, ... то). (3.218) 
Suppose that the jth derivative also has discontinuities of the first: 
kind at the points х0), x ..., хд, with jumps 
AD = FOP +0) 7900 — 0) (3.219). 
(-1,2,..., m; j=l, 2,..., K) 


We can now write f(x) in the form 


mo | ў m | 
fe) = Y оох x) + У Ао (кх)... 
t=, Л Iv 7 


eo Y Монос хф) +908), (2220) 
=1 
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or 
1 È | 
fo-iy b Мох x) +90), (3.221) 
3-0 lel 
where 
a fo -2x-«u-«0, 
= sinnu 
eu 2, п T T for 0< u< 27, 6.222) 
0 for u= 0, 2л, —2л. 
o,(u) = Г во (и) и-= pas Y Ree 
0 n=l 
2 
т 610 fo -2л=и = 0, 
t ica (3:223 
D4 for OsSus2a 
Further integration gives us o2(u): 
о) =. — LS Hum. eee (Qmuzs2m. (3.224) 


The function ф(х) is continuous along with its first k derivatives, 
and its Fourier series 


P(x) = 32+ У (æn cos nx +B, sin nx) 
n=l 


is rapidly convergent, since the coefficients о, and f, have the order 
1/n**?. If we take into account the expansions (3.222)-(3.224), the 
series for f(x) will be 

Mo оо (0) оо 1) 
f@= Ein кө b sin n(x — x?) ur io $ cos с xo 


n t= T nal 


оо 2) 
-lpo sin п(х— xf + 
i л PI т 


DE Y (кы созпх+ й, іп пх). (3.225) 
n=l 
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The slowly convergent parts have thus been separated out from 
Fourier series (3.217). 

We often obtain by some method the Fourier series for a function 
without knowing the function itself; here, if the series is slowly con- 
vergent, it is of little use for computing the values of the function, 
not to mention the values of its derivatives. It is often possible to 
improve the convergence in this case, by making use of familiar series 
for o(x—x,), etc. This will be shown with the aid of an example 
(ref. 3). 

EXAMPLE 55. We are given the Fourier series 


2 = "905 n 
Дх) = E тр nn (0zmxzamm. (3.226) 


We separate out the lowest power 1/n from the coefficient: 


лы 
ив, 


The initial series can now be split into three: 


za cos nz „ с08п-> 
АХ) = -= У sinnx—-— Y 3—- sin nx— 
T п: n=l 
2 = CSIF 
Um nom Sin nx. (3.227) 
The first two series are summable in the finite form: 
cos n T. 
50) -2-—X sin nx = 
im 
sin n| x 5 +sinn| x x 
gual ta 3^. 
© жу, п 2 
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„ sinn (+=) {ти (2) 
ў 2 2 
= HE (=+ ipe (:-3)]. (3.229) 


іх 
Гата 

© 

IA 

x 

A 
n| a 
М 


х-л л 
Six) = Um э =Х=Я]}, (3.230) 
0 (« = 5) 5 
xe m NE 
бл +24 Ету 
S(x) = (3.231) 
(х-л) л л 
| — бт 3 0-90 (Fran а 
Consequently, 
cos n= 


Лх) = S109 + SG) — = x BOR) sin nx. (3.232) 


The remaining series is rapidly convergent (its coefficients are of 
order 1/15) and the expression (3. 232) obtained enables us to evaluate 
easily the values of the function and of its first derivatives. 

In the case when the series given above for oy, с, с; are insufficient 
for improving the convergence, the following series may prove useful: 


cos xj cos 2x +5008 Зх+... = 


= —Re[in|1—e*}] = ~1n [2 sing (3.233) 
| 
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and its analogue: 


соѕ 2х соѕ 3х cos Чу, 
pa ТОЗ "584 


zo X 
2 sin — 


= (1— cos x) In 5 


+ (5- 3 sinx+cosx. (3.234) 


By using these last series, we сап improve the convergence of any 
series of the form 


i lY. 1 E 
p [(4 (=) sin nx +B (2) cos =) sin nx + 
IY. 1 
41€ > |від ах +В 71 COS лхо | cos их |, 


where A(1/n) B(1/n), C(l/n) D(1/n) are analytic functions of 1/n 
for small values of the argument. 


9. A. S. Maliev's method of improving the convergence of 
trigonometric series 


The Fourier series of a function is slowly convergent if it has deri- 
vatives of all orders inside the interval (0, 2л), while the function 
or one of its derivatives has different values at x = 0 and x = 2x. 
The following method was proposed by А. S. Maliev for obtaining 
a rapidly convergent trigonometric expansion of a function of this 
kind. 

Let f(x) be given in the interval (0, л), where it has continuous 
derivatives up to and including the (k—1)th order and the kth 
derivative satisfies Dirichlet's conditions, This function can be expand- 
ed as a series in functions cos 2лх and sin 2nx, or as a series in sin 
nx only or in cos zx only (depending on whether the continuation 
of f(x) into the interval (—л, 0) is even or odd). These series are 
in general slowly convergent. We can arrange for order 1/n*+} in 
the Fourier coefficient if we first continue the function into the 
interval (—7, 0) in such а way that, when continued periodically 
on to the whole of the real axis, the function has k derivatives, where 
the kth derivative satisfies Dirichlet’s conditions. 
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For this, we take f(x) in the interval (—л, 0) in the form, say, of 
а (2k — 1)th degree polynomial ф(х), having, along with its derivatives 
up to the (k—1)th order, values at the points 0 and л, respectively, 
equal to the values of f(x) and its derivatives at x = 0 and x = л. 
We can conveniently choose ф(х) as 


ф(х) = (xn) Гаа... + 1)! ыы T 


+х* E +B xm. cuis Di (x i». 


The coefficients Ay, Ay, ..., 4,4; Bo, By, ..., B, , are now deter- 
mined successively from the equations: 
Ф(0) = л®4„ = ДО), 
Ф'(0) = kn*7 14, EA, = /'(0), 
Ф100) = CP А-П... 2лА + СА (Е 1)... 32244 ... 
weet Сшйкл®-1А,_ 2 + СЕНА, = 79-00); 
$(—п) = (—л)%В, = f(m, 
ф(—л) = k(—m)*71B * (—2)*B, = Г), 
gh-3(—5) = Сў_,К(К—1)...2(—хл)В+ 
TCLjk(k—-1)...3(—-2YB, +. 
* CIEKC = 79-000, 
After constructing the polynomial g(x), we get the function 
ф(х) for -zzxz 0, 
yx) = 
f(x) for 0zxzm. 

This function, continued periodically, has k— 1 continuous deriva- 
tives and а kth derivative satisfying Dirichlet's conditions. The 
Fourier series for y(x) is as convergent as 1/и^+1 and yields f(x) in 
the interval (0, л). 

EXAMPLE 56 (ref. 3). 


о = x-5 @=х=л). 
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Let k = 3 (for convergence of the order 1/n*), Now, 


9) = (аваз) + 
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ir бн]. 


On expanding as а series the function 


«(x (-л=х = 0), 


vo) = Uo (02 x m2) 


fo) = 240 у (=- жа) cos mx IO 


3 * a 
7T оп=],3,5...\” 


nm, 4, 6,... 


I. 
= sin nx. 
n 


CHAPTER IV 


ORTHOGONAL SERIES AND 
ORTHOGONAL SYSTEMS 


Introduction 


A sequence of functions (/,(x)) is said to be orthogonal in the 
interval (a, Б) if, for i з j, 


[леле ах = 0. 


An important role is played in analysis by the representations 
of functions as orthogonal series: 


У, с, 

nel 
i.e. series in an orthogonal system of functions. Trigonometric series 
are the classical example of orthogonal series. 

The theory of orthogonal series arose in connection with the. 
solution of problems of mathematical physics by the so-called Fourier 
method. Linear integral equations with symmetric kernels may also 
be solved by means of orthogonal series. 

The theory of orthogonal systems of functions has a remarkable 
analogy with the theory of orthogonal systems of vectors (see Chapter 
П, $ 1). This analogy was observed long ago and has been reflected 
in the terminology. It led in the course of time to the conception 
of Hilbert space — the infinite-dimensional analogue of n-dimensional 
Euclidean spaces (see Chapter П), the role of orthogonal systems 
of vectors being played in Hilbert spaces by orthogonal systems 
of functions. To provide a valid basis for the theory of orthogonal 
systems of functions, the basic concepts of analysis had to be gener- 
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alized; in particular, generalization of the concept of integral led 
to the Lebesgue integral. 

The more elementary part of the theory, and especially the “com- 
putational” side of it is described in the present chapter. Unless 
there is a special proviso, the integral is understood in Reimann’s 
sense throughout this chapter. 

n-dimensional vectors can be interpreted as functions defined at 
п points; this interpretation is discussed in broad outline in $1, 
sec. 1; it throws into greater relief the analogy with orthogonal series 
of functions. Biorthogonal systems of functions — the analogues of 
biorthogonal systems of vectors — are discussed in § 2, sec. 6. The 
first example of such a system was offered by P. L. Chebyshev in 
connection with interpolation problems. 

Orthogonal systems of functions are connected with problems 
of approximation of complicated functions by simpler ones, when 
the measure of the closeness of two functions f(x) and ф(х) is provided 
by their square derivation: 


f L- pF dx. 


The problem of the best approximation (from this point of view) 
of a function by polynomials led to the creation of the theory of 
orthogonal polynomials (the simplest system of orthogonal functions). 
The first example of an orthogonal system of polynomials was the 
system of Legendre polynomials. The general theory of orthogonal 
systems of polynomials is due to P. L. Chebyshev. This theory is 
described in § 3. 

The classical systems of orthogonal polynomials are discussed 
from a unified view-point in § 4, sec. 1—4. 

The later sections of § 4 are devoted to concrete systems of poly- 
nomials — those of Legendre, Jacobi, Chebyshev, Hermite, Laguerre 
(as also Chebyshev’s analogue of Legendre polynomials for a finite 
number of points). Good uniform approximations of functions 
can be obtained in a number of cases with the aid of segments of 
series in orthogonal polynomials. Such approximations are obtained 
very often from segments of series in Chebyshev polynomials (see 


$ 4, sec. 7). 
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§ 1. Orthogonal systems 


1. Orthogonal systems of functions defined at л points 


Logically, the simplest example of an orthogonal system of functions 
is provided by a system of functions that are defined at п points. 
We shall confine ourselves to functions of one variable (everything 
said can be generalized immediately to functions of several variables). 

Let x,, ху, ..., x, be a finite set of numbers (or points of the 
real axis) and let f(x,) be functions defined at these points. Each 
such function can be regarded as a vector f with components f; = f(x;) 
(i= 1, 2, ..., n). The length or norm of such a vector is 


ifi = pu (4.1) 


The set of these vectors (functions) forms an n-dimensional Euclidean 
space, which is denoted by the symbol E,(x,, хз, ..., Хи) (see Chap- 
ter П). 


A basis in E, (Xy, Xs... Xn) is any system of n linearly in- 
dependent functions f, f®, ..., f? on the set xy x», ..., Хи, 


2. Orthogonal systems in E,(xj, xy, ..., x) 


Functions f(x;) and g(x;) are orthogonal on a set of points ху, x», ..., 
xy if 


= È fio Ў Mado) = 0, 4.2) 


which corresponds to the orthogonality of the vectors with coordinates 
fiand фї = 1,2, ..., n). 

A system of functions? (х) (k = 1,2, ..., D of Ep (xy xs... Xn) 
is said to be orthogonal if 


; НГО 122 0 for k=j, 
) f» = 4.3 
(79, pm) { 0 for k#j. (8) 


An orthogonal system of п functions is described as complete. 
There exists іп E, (х), №, ..., Xn) an infinite set of orthogonal 
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systems of л functions {7%} (= 1, 2, ..., п); the functions of 
each such system form an orthogonal basis in space E, (x1, xs, ..., Xn) 
Every function f(x;) of E, (xy, ..., Xn) is linearly expressible in terms 
of the functions of an orthogonal basis: 


fo = È 6S. (44) 


The coefficients c; in (4.4) are called the Fourier coefficients of the 
function f in the system of functions 10, f9, ..., f), where 


а= (79) = È ал. @5) 


The coefficient с; is the projection of the vector f on to the base vec- 
tor f®, 

If {| / 9? || = 1 for all the f? (j= 1, 2, ..., п) of an orthogonal 
basis, the basis is said to be orthonormalized. If the basis f (j = 1, 2, 
..., п)із orthonormalized, we have for any function /(x,) of E, (x, 


Xe o, и): 


їл = Y d, (4.6) 
j=l 


where the с; are the Fourier coefficients of the function f in the ortho- 
normalized system (f) (this follows from (4.4) and the linear 
properties of the scalar product). 

If an orthogonal normed (|| f || = 1) system is not complete, і.е. 
the number of its elements / < n, instead of equation (4.6) we have 
the inequality 

П 


ПА = рУ <. (4.7) 


Equation (4.6) and inequality (4.7) transform in the limit as n — e» 
to Parseval's equation and Bessel's inequality respectively (see $ 2, 
sec, 4). 
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3. The best mean square approximation 


The square approximation of a function f(x) by a function g(x) with 
respect to a system of points xj, X», ..., x, is defined by 


lf ell = (| È о ee. 4.8) 


We shall discuss generalized polynomials of the ith order, і.е. 
functions of the form 


È, а/а), (9) 


where (f'P) (k = 1, 2, ..., 1; l< n) is an orthogonal system of 
functions of E, (xy, Xs, ..., X4). | 
THEOREM 1. From among all the “generalized polynomials” of the 
[ар order (1 = n), the best mean square approximation of a function 
f(x) at the points ху, хь, ..., x, is given by a polynomial of the form 
П 


- Y af 9x), (4.10) 
xz 
where cy are Fourier coefficients. 
This Аһ order polynomial coincides with the sum of the first 7 
terms of sum (4.4). This best approximation vanishes when /= n. 


4. Orthogonal systems of trigonometric functions 


The most important examples of orthogonal systems on a finite 
set of points are first the orthogonal systems of polynomials introduced 
by Chebyshev (see $ 4, sec. 11), and secondly, orthogonal systems 
of trigonometric functions. 

EXAMPLE 1. The system of functions (cos kx,} (k = 0, 1, 2, ..., n) 
is orthogonal on the system of 2n points x; = т/п (i = 0, +1, +2, 
.... tn—1, —n). Any even function f(x), defined at these points, 
is expressible by the sum 


Иж) = tex ey cos kay, (4.11) 
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where 
1%) 
Ch 2 — У f(x) cos kx, 
N imon 


EXAMPLE 2. The system of n— 1 functions {sin kx) (k = 1,2, ..., 
п— 1) is orthogonal on the system of 2n—1 points x, = ix/n (i= 
= l, +2, ..., «<л—1, —n) Any odd function ¢(x,), defined at 
these points, is expressible as 

nol 
Ax) = У ey sin kx, (4.12) 
k=l 
where 


1 n " 
EO 026 ф(х) sin kx, 


EXAMPLE 3. The system of 2n functions cos kx, sin /x, where 
k=0, 1,2, ...,”;/= 1,2, ..., n—1, is orthogonal on the system 
of 2л points 


ч = == i= 0, +1, £2,..., n—1, —n. 


Any function (x,), defined at these points, is expressible as 


у(х) = foy (ay cos kx, + by sin Кх). (4.13) 
where 
= aL. = p(x;) cos kx, 
= bom. 5: р(х) sin ху. 


Formula (4.13) reduces to (4.11) if у(х) is an even function, and 
to (4.12) if p(x) is odd. 

Any periodic function p(x,), defined at all points x; = т/п, where 
i is any integer, is expressible by (4.13), or by (4.11) or (4.12) if it 
is even or odd. 

These formulae, deduced by Euler and Lagrange, transform to 
(4. 42) and (4.43) as n — <>. They are atthe basis of numerical methods 
of harmonic analysis 
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§ 2. General properties of orthogonal and biorthogonal systems 


1. Orthogonality. Scalar (inner) product 


The orthogonality of two vectors in n-dimensional Euclidean 
space is well known to consist in the fact that their scalar product 
vanishes (see Chapter II, § 1, sec. 3). The orthogonality of functions 
is defined by analogy with the orthogonality of vectors. 

The scalar (inner) product of functions f(x) and g(x) on [a,b] is 
defined by the expression 


he f °С dx. (4.14) 


(We naturally assume here that f(x).g(x) is integrable in [a, 5}.) 
If 


a= | ” део ах = 0, 


Дх) and g(x) are said to be orthogonal on [а, Б]. 
EXAMPLE 4. The functions sin x and cos x are orthogonal on the 
segment [0, л], since 


o 


[sin cos xas = es 
Я 2 

The orthogonality of functions with respect to a weight function 
is a further generalization of the concept of orthogonality. 

Let р(х) be a fixed non-negative function in [a, b]. 

Any two functions f(x) and g(x), for which 


| ° йк бдр) dx = 0, (4.15) 


are said to be orthogonal on the segment [a,b] with respect to the 
weight p(x). 

EXAMPLE 5. The functions sin (n arc cos x) and cos (пагссоз x) are 
orthogonal on [—1, +1] with respect to the weight 1/4/1— x?, since 


+1. 1 
| 5їп`(л arc cos x) cos (л arc cos х) ах = 


-1 /1—2% 


= sin mu-cos nu du = 0. 
0 
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All the integrals considered in this chapter will be assumed to 
exist in Riemann’s sense. 


The concept of orthogonality can be generalized in a natural manner for 
functions f(x), g(x) and the weight р(х), which are Lebesgue but not Riemann 
integrable. 

Let p(x) be non-negative in (a, b], non-zero ona set of measure zero and Lebesgue 
integrable on [a, 5]. Now, 


P(x) dx > 0, 
a 


- fb b 
Let f(x) be such that | {3(х) dx exists in the Lebesgue sense. Then | /° (р(х) dx 


а а 

also exists. We say in this case that f(x) is square integrable with respect to the 
weight p(x) on [а, 5] (in the Lebesgue sense), and we write Пека, b) for the set 
of such functions. 

If р(х) яа 1, we use the simple notation L*(a, b). 

For instance, the function f(x)=x7"? belongs to L*(0, 1), whereas f(x) = x7"? 
does not. 

The following proposition holds: if f(x) and g(x) belong to Lola, 5), then 


b 
| Sep) dx 


a 


exists, and the Cauchy—Bunyakovskii inequality holds: 


b i PR 
| Sep) dx = Л Prone ae | 8°(x)p(x) ах 


a a a 


(this latter is a generalization of the corresponding inequality for vectors, see 
Chapter II, § 1, sec. 2). 


The scalar product in ACA b) of functions f(x) and g(x) is defined by the 
expression 


b 
(л 2) = | Sgp) dx. 


а 


The functions f(x) and g(x) of L}.,,(a,5) are said to be orthogonal with respect 
to the weight р(х) if (f, g)=0. 


Let о(х) be a non-decreasing function in [a, b]. Let us consider 
the functions f(x), for which the Stieltjes integral exists: 


|, (х) do(x). 
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b 
In this case | f(x) do(x) also exists.) The set of such functions 


a 
will be denoted by 22. „(а, Б). 
There exists for any two functions f(x) and g(x) of І а, b): 


f ” feels) 4) (4.16) 


and the corresponding Cauchy-Bunyakovskii inequality holds. 
Integral (4.16) is called the scalar (inner) product of functions f(x) and 
a(x) of Та „Ха, D). 

The functions f(x) and g(x) are said to be orthogonal with respect 
to the integral weight o(x) if 


a= | ° Og do(x) = 0, 


ie. their scalar product vanishes. 
In the case when o(x) has a finite number of growth points: xj, 
Хә, +++) Xp, integral (4.16) becomes the finite sum 


È Ade ad еб: +0) -olr 0), 4.17) 


If all the jumps of o(x) are equal to 1, i.e. 
a(x +0)—o(x,—0) = 1 
for all i, (4.17) becomes 


n 


à ИКхдеса). (4.18) 


j= 


The orthogonality of f and g is influenced here only by their values 
at a finite number of points — the growth points of o(x). In this 
connection, the functions f and g can be regarded as specified only 
at these points (as in § 1, sec. 1). In this case (4.18) is the ordinary 
scalar product of the vectors f and Е of Е, (х1, ..., Xn) The case 
when o(x) has a finite number of growth points is singular inasmuch 
as it is only in this case that there exist only n linearly independent 
mutually orthogonal functions (see $ 1, sec. 1). 

The above concepts relating to the orthogonality of two functions 
are united by a common property: the inner product of the functions 
f(x) and g(x) is in each case equal to zero. The whole of our sub- 
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sequent discussion (unless there is a special proviso) will be independent 
of the particular method by which the concept of inner product 
is introduced. We shall thus use in general the symbol (f, 5) to denote 
the inner product of f(x) and g(x), i.e. this symbol may be defined in 
any of the ways described. The case when 


(ә = | ЛЕС dot). 


unites all the other definitions of scalar product. The case of a “differen- 
tial” weight p(x) is obtained from this when o(x) has an integrable 
derivative, and do(x) = p(x) dx, so that integral (4.16) becomes 


| " ође дро) dx. 


Orthogonality without a weight is the case when do(x) — dx. The 
orthogonality of functions defined at a finite number of points corres- 
ponds to a finite number of growth points of о(х). 

In future, we shall therefore use expression (4.16) for (f, g), where 
necessary. 


The scalar product of the function f(x) with f(x), i.e. (f, f), is usually 


denoted by || fl]? and || || 2 4/(/,//) is called the norm of the function. 
This quantity is the norm of f(x) in the corresponding normed space. 


The quantity 
fell = _| | " (fg? dol) 


is called the root square deviation of functions f(x) and g(x). This 
is the measure in the accepted sense of the closeness of f(x) and 2(х). 


2. Orthogonal systems of Bessel functions, Haar functions, etc. 


Let any two functions of the sequence 
p(x), Px), ж» 9«(x), SEL. 


be orthogonal on (a, D), i.e. (p p) = 0 if =j. 
Such a sequence is described as an orthogonal system of functions 
on (a, b). If the system of functions 


P(X), ф(Х),..., ou, ... 
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is orthogonal and each of the functions differs from zero, the system 
of functions 


_ $9 EET NE 
#9 = Тост" @ = Тә, = Teo 


is also orthogonal. Every function of this system satisfies 


Ip) = Qs vi) = 1. (4.19) 


Such systems are extremely convenient. They are described as 
orthonormalized (or orthonormal). 
The orthogonal system 
P), P), ees Фабх), ... 


is said to'be complete in the space Шуа, b) if, among all the 
functions of [2 „(а, Б), there is none that is non-zero and orthogonal 
to all the functions of the system 


P), ф(Х),..., Pa), ..., 
ie. the fact that 


| одра) д) = 0 


for all л, implies that 
К = 0 


(excluding possibly a set of measure zero). 

In the case of a finite number of growth points of o(x), a complete 
System contains as many functions as there are growth points of 
a(x). 

EXAMPLE 6. The system of functions 

sin x, sin2x, ..., SIN AX, ... (4.20) 
is orthogonal on (0, л), since 
| sim sina =0 for т=п. 
0 
The system is complete. 
EXAMPLE 7. The system of functions 


l, cosx, cos2x, ..., cos nx, ... (4.21) 
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is orthogonal on (0, л), since 
r 
f cos тх соѕ их ах =0 for mæn. 


0 


The system is complete. 
EXAMPLE 8. The system of functions 


1, sin x, cos х, sin 2x, cos 2x, ..., sin nx, COS AX, ... (4.22) 


is orthogonal оп (0, 27), since 


2л 

| sin mx cos nx dx = 0 for. any m and n, 
л 

| sin mx sin их ах =0 for mæn, 


?х 
| cos тх созих dx =0 for т=п 
(т = 0, 1, 2,...; п=0,1,2,...), 


The system is complete. 
The system of Bessel functions. Let J,(x) be the Bessel function of 
order п, and À,, А), ..., А»... the positive roots of the equation 


Л(х) = 0 


or of the equation 
Ji (x) = 0. 
The system of functions 


Ју), Л.А), Лз), .... InAs ... (4.23) 
is now orthogonal in [0, 1] with respect to the weight x, since with 
izj: 

f Ja (Ax) I, (Agx)x dx = 0, 
0 


The system (4.23) is complete. 

The system of Haar functions. In recent times а use has been found 
for the orthogonal system of Haar functions. This system consists 
of piecewise constant functions xt, where 


182 MATHEMATICAL ANALYSIS 


WO =) _ К 
0 
J2 
P(t) = = i^ Jz 
0 
2 
PO = 
WP) = PET d 
«Ро = E 


м 

55 

X 

= 

— 

ll 

———M— а 
1 
© mm m 


- for te, Ц; 


1 
for refo, i) 
1 
for 'e(s i], 


for t= 


for t€ E 1) , 
for t€ (= z| , 
at other points; 

for t€ E | , 
for t€ С i] 


at other points; 


(4.24) 
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ze) = EX for te (z 1 ‚ (4.24) 


O at other points. 
In general, 
WO = УМ, xaX 
2-2 2-1 

vV? for «|252, AR). 
PORE =z 2-1 2k 4.25 
@) — for He : EJ (4.25) 

O at other points [0, 1]. 

The Haar functions are generated from the “polygonal functions” 


of Schauder's basis. The orthogonality of the Haar system follows 
from the fact that, given the same n, 


P =0 fo j-kml 
50 that 
(00, xt) = 0. 


Given different subscripts m and n, where т > n, and any j and k 
the sub-intervals, where x/P(r) ғ 0 are wholly contained in the intervals 
of constancy of yi(f) for т> n, and 


2k 
2ml [ym / 
f х (0) а Zi YP) dt = (X 2m*i mE )- 0, 


3-1 


where 4 is the value of д on the interval of constancy. 

The system of Haar functions has an important approximation 
property: the Fourier series (see Chapter ПТ) of any continuous function 
with respect to the Haar system is uniformly convergent to it in [0, 1]. 

The concept of orthogonality of functions of one variable on a 
segment may be generalized in a natural manner to functions of several 
variables, defined in some domain. — 
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The functions КР) and g(P) of a point Р of n-dimensional space are 
said to be orthogonal with respect to a domain D of this space if 


| S(P)g(P) dP = 0. (4.26) 
D 


A similar definition can be given of the orthogonality of КР) and g(P) 
with respect to the weight k(P): 


| S(P)g(P)k(P) dP = 0. (4.27) 
D 


EXAMPLE 9. The problem of the vibrations of a plane clamped mem- 
brane leads to the differential equation 


AU+i{U = 0 


(where A is Laplace’s operator) with the boundary condition U = 0, 
The eigenfunctions of this equation, corresponding to different values 
of 4, are orthogonal: 


| | Ue NUE J) dx dy = 0 
G 


EXAMPLE 10. Let gi(x), ф(х), . . ., ф(х), .. .beasystem of functions 
orthogonal on the segment [a, b]. The system of functions 


U, Кх, 3) = HOMO) (4.28) 


is now orthogonal with respect to area on the square а= х =£ Б, 
а=у=Ь. 


b fb 
For | | рО Gm ORO) dx dy = 
аа 
b b 
- | eO) dx | ОО) dy = 0, 
а а 
if either i з k or j # l, i.e. if U, x, у) and U, (x, у) are different 
functions of system (4.28). 


Systems of the form (4.28) are utilized, for example, in the expansion 
of the symmetric kernel of the integral equation 


ф(х) = af K(x, s)g(s) ds + f(x) (4.29) 


as a series in the eigenfunctions of the equation. 
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If {p{x)} is a normed system of eigenfunctions of (4.29), corres- 
ponding to the eigenvalues 1/4,, while {O,(x)} is asystem of eigenfunc- 
tions corresponding to the zero eigenvalue, the system of functions 
(where i and j are arbitrary): 


PLP), Обе, 908), ООД, (4.30) 


is orthogonal оп the square (а S x = b; а = s = Б), since the system 
(eG), 0,(x)} is orthogonal оп [а, 5]. 

System (4.30) is complete in the space of functions square integrable 
on (а= х=}; а= 5 = Б). Hence the square integrable function 
K(x, s) can be expanded аз a series in this system. The Fourier coeffi- 
cients of the function K(x, s) with respect to the functions 9,(x)p,(s) 
for i з j, O{x)p,(s) and ф(х)О (х) vanish for any i and j, while with 
respect to the functions y{x)p,(s) they are equal to 1/4, by virtue of 
the relationships 


| : f K(x, DPPC) dx ds = f " px) dx [ ” Kis, зур) а = 
E xl COLETE # duy 
b fb b b 
[| | K(x, s}p(x)O,(s) dx ds = | ф(х) «| K(x, 5)0$) ds = 0, 


f li K(x, pols) dx ds = f edo) dx | ” K(x, s)p(s) ds = 


= 1 (оро) = 
= > a д = 


Hence Кз) = Ў T en» 

The concepts of orthogonality of functions with respect to surfaces 
and curves can be treated in the same way as the above orthogonality 
of functions in a domain D of n-dimensional space. For instance, the 
spherical Laplace functions are orthogonal with respect to the surface 
of a sphere. 
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3. Linear independence. The process of orthogonalization 


A system of n functions is said to be linearly independent if, given 
any system of n numerical factors, for which 


n ы 
DET 
ES 


the function A,9,(x)+4.9,(x)+...+4,9,(x) is non-zero. If there 
exists a system of factors 2; such that 


Аф) +1592) +... +19 ©) = 0, (4.31) 


` where at least one 4; differs from zero, the system of functions ф(х), 
ф(х),..., 9, (x) is said to be linearly dependent. (In the case of func- 
tions of Ша, 5), equation (4.31) can hold for a linearly independent 
system on a set of measure zero.) 

The concept of linear independence of functions is similar to the 
concept of linear independence of vectors of n-dimensional vector 
space (see Chapter II, § 1, sec. 4). 

Let the inner product (p; p;) be defined for any pair ф(х), (x) of 
the function system фи(х), e(x),..., ф„ (x). 

In analogy with the Gram determinant for a vector system (see 
Chapter П, $ 1, sec. 5), we introduce the determinant 


(py v) (ФФ)... Фь Pr) 
4, 2|» PD Po Fa) ++» Ф Pn) | (4.32) 


(ФьФ) (Qa. Ф) ... (Ф, Фа) 


which is called the Gram determinant of the function system. 

Properties of the Gram determinant. 1°. The Gram determinant 
4, = 0 for any system of functions. 

2°. Let the system of function, фу, фо, . . ., Pn be defined on the seg- 
ment [а, 5] and let the interval (a,, bj) be contained in (а, Б). 

Now, if 4, is the Gram determinant of the system in [а, 6] and 
(Ф, ф) is defined by 


(фь Ф) = k 9o, (x) do(x) 


ORTHOGONAL SERIES AND ORTHOGONAL SYSTEMS 187 


while A‘, is the Gram determinant of the same system in [a,, 5j], 


we have 
An = Ар. 


This property also holds for the Gram determinant of functions of 
several variables in a domain Q: the Gram determinant can only 
diminish when the domain diminishes. 

THEOREM 2. The necessary and sufficient condition for a finite system 
of functions to be linearly independent is that its Gram determinant 
be different from zero. 

. THEOREM 3. Every finite orthogonal system of functions is linearly 
independent. 

Theorem 3 is an obvious consequence of Theorem 2, since the 
Gram determinant of an orthogonal system of functions is equal to 
the product of the squares of the norms of all the functions of the 
system, each of which is greater than zero. 

An infinite sequence of functions ф(х), ф(х), ..., Pa) ... 
is said to be linearly independent if any finite sub-system of it is linearly 
independent. 

Given the system фу, фо, ..., Pn of linearly independent functions 
and some function f(x), let us consider the problem of the best root 
square approximation of f(x) by means of linear combinations of 


n 
the system, i.e. from all the linear combinations У др we find the 


ici 
one that gives a minimum for the expression - 


I- $ dipi { 
i=l 


The coefficients of the best linear combination are found from the 
system of linear equations 


д п 
с E di i 
да, ( f PH 


4.09, Ф) + (9, Ф) +... thin Ф) = (Ж, Ф), | 
dP ф)-+%(ф›, Ф) +... +40 Фә) = Cf, Фа), (4.33) 


2 
Je? (k= 1,2,..., n) 


ie. 


di(gy, Pn) + d (pos Фа) + ... +4n(Pns Фа) = (№ Фа). 
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The determinant of this system is the Gram determinant; in view 
of the linear independence of the initial system, it differs from zero 
and (4.33) has a unique solution. Obviously, it is easiest to find the 
coefficients d}, d», . . ., d, from (4.33) if the initial system is orthogonal. 
In this case (4.33) becomes the system 


dpi, Ф) = (f, vy) (k= 1, 2,..., н). (4.34) 


By starting out from any (finite or infinite) linearly independent 
system of functions (or vectors), an orthogonal system can be formed, 
the elements of which are certain linear combinations of the elements 
of the initial system. Let us consider the process of forming such a 
system. It is called a Schmidt orthogonalization process. 

Suppose we are given the linearly independent system 


91, Pas sees Pns sss 
We put 
p(x) 
w(x) = р. 
(9, p)” 
Let 


V; = ф(х)— Co (x). 
The coefficient c, can be chosen so that (ys, œ) = 0, by putting 


Cn = n = = (Po ex). 


Having chosen such a сз, we put 
y.) 
ох) = РЕ, 
(Ya а E 


Here (ys, 42) » 0, since otherwise y(x) = 0, and this would mean 
that p, and p; are linearly dependent. 

Suppose that functions @,, о, . . ., €,. ; have already been found. 
We now put 


эд) = бд E ener), 


here the numbers c,; are chosen so that у(х) is orthogonal to all the 
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functions @,(x), ..., @,_,(x). We must take for this: c4; = (Pw c). 
We next put o, (x) = v,G)/(p,, v.) ^, where (фи, Pa) = 0 in view of 
the linear independence of the functions gj, ..., Фл_1. This process 
can be continued indefinitely. 

The system ,(x), . . ., o, (x), . . . thus formed will be orthonormalized 

The process of orthogonalization of a vector system is precisely 
similar. 

In the case of a vector system in n-dimensional space, or of a system 
of functions defined at п points, such a system contains not more than 
n elements. 


4. Fourier coefficients, Closed systems 


Let 
ох), в (х), ..., eux) ... (4.35) 


be an orthonormal system of functions. Given a function f(x), suppose 
that its inner product exists with any function of the system. The 
numbers с; = (f, оу) are called the Fourier coefficients of f(x) with 
respect to system (4.35) In the particular case when (4.35) is a trigono- 
metric system, the c, are the familiar Fourier coefficients of the theory 
of Fourier series. 

The Fourier coefficients of functions are the analogues of the pro- 
jections of a vector on to the vectors of an orthonormal vector system. 
If all the Fourier coefficients of a function exist, we can formally 
construct the series 


Ў со). (4.36) 
kel 


This series is called (in analogy with the corresponding series with 
respect to the trigonometric system) the Fourier series of f(x) with 
respect to the system (x), ..., @,(X),... - 

Bessel’s inequality and Parseval’s equation. We can write Bessel’s 
inequality for any f(x), for which (f, f) and all the Fourier coefficients 
exist: 


ds f (4.37) 


л 
i= 


— 
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from which it follows that the series У c? is convergent and 


iei 
>, es f. (4.38) 
= Е 
In the particular case when Y c? = (f, f), (4.38)isknownas Parseval's 
та 1 
equation. 
Let 


ox(x), cxx), oa) w(x), pee (4.39) 


be an orthonormal system of functions on (a, b), and f(x) a function 
defined on (a, b) for which (f, f) exists. 

When considering the problem of the best root square approximation 
of f(x) by the linear combinations 


п 
2 4 (ох), 
we arrived (see sec. 3 of this article) at an expression for the coefficients 
of orthogonal system {w,(x)} giving the best approximation (4.34): 


_ Фе 
4 Е (юл, OX) i 


which yields in the case of a normed system: 
d, = (f, Oh) = су. 
From this there follows: 


n 
THEOREM 4, Ofall the linear combinations У, dw х), the finite Fourier 
sum 21 


Š cio (x) 
í 


has the least root square deviation from f(x) (i.e. the linear combination 
for which d; = с). 

The orthonormal system w(x), ..., о„(х),... is said to be closed 
if Parseval’s equation is satisfied 


Ў а= f ° PG) а) (4.40) 
л а 
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for any function f(x) of Г (а, Б). In this case, 
b 
f'G)dex)- Y А-0 as п, 
a R i=1 


which implies, in view of the equation 
b n b n 2 
| узо) 40) 3, с? -Í | fG) x seo | do(x) 
a 1= а i= 


that the root square deviation 


b n 2 
| [9-5 09} а) (441) 
a d 
tends to zero as п — оо. 

If (4.41) tends to zero as n + œ, we say that the Fourier series 


Ў ош 


is convergent in the mean to f(x). 

Consequently, if f(x) belongs to L? (a, b), its Fourier series with 
respect to any closed system is convergent to it in the mean. 

EXAMPLE 11. The trigonometric system (4.22) is closed in (0, 2л.) 

EXAMPLE 12. 

THEOREM 5 (V. A. Steklov). The set of eigenfunctions of the Sturm- 
Liouville equation forms a closed system. 

It was in the context of this theorem that V. A. Steklov introduced 
the concept of closure of a system. 

It follows from Parseval’s equation that every orthogonal system, 
closed in I2 (a,b), is complete, and every complete orthogonal system 
іп 12 „а, Б) is closed. 


g(x; 


5. Fourier series in a trigonometric systemt 


The problem of representing an arbitrary function f(x) by a trigo- 
nometric series 


E + y (a, cos nx +b, sin nx) (4.42) 
л=п 


+ See Chapter III for more detailed information on trigonometric Fourier series. 
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arose in the middle of the eighteenth century in connection with the 
problem of the vibrations of a string. This problem occupied all the 
greatest mathematicians of this period. The essential step in the solu- 
tion of the problem was taken by Fourier, who established} that, by 
virtue of the orthogonality of the trigonometric system, the coefficient 
of series (4.42) can be expressed in the form: 


Saree 
а [fend 

1 f? 
ад = —— | f(x) cos nx dx, (4.43) 

0 

aC 
“| f(x) sin nx ах 

T 0 


(bence the name Fourier coefficients in the case of any orthogona- 
system). 

Fourier stated the theorem to the effect that a (graphically) arbitrary 
function can be represented by a Fourier series. 

Historically, the first theorem on the convergence of Fourier series 
was: 

THEOREM 6 (Dirichlet, 1829), Any function that admits of integration 
in any interval in (0, 2л) and does not have an infinity of extrema т 
the interval can be expanded as a Fourier series, which is convergent at 
every point x to the value 


f(x +0) +Кх- 0) 
Ee ies 


'The crucial point in Dirichlet's proof was the representation of 
the partial sum s,(x) of the Fourier series and of the remainder in 
the form of integrals: 


. 2n 
sin 


HO ea) 


s) = 3 f duc = & 
5 2 


+ This had been noticed before Fourier by Euler. 
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and 
. 2n 
sin —— 


fe)-59 = xls (fe) (a) 


together with the following observations: 


(1) if0- c < 5% then as n =, 


[0 48 = o0 


sin B 


Qif0<b<cs j^ and g(f) is monotonic, then 


f ФВ) —— sin (27 +1)8 dB — as n= о, 


яар 


А rather more general theorem may be proved by the same method. 
THEOREM 7. If f(x) is a function of bounded variation, its Fourier 


series is convergent at every point x to the value 5 [f(x+0)+f(x—-0)]. 


If, in addition, f(x) is continuous at every point of some interval, the 
Fourier series is uniformly convergent in the interval. 
THEOREM 8 (Lebesgue's Test). Let 


P(t) = ex) = fix + fix 0— 2f) 


and 
h 
$.) -| ОГ? 
„190 
у 
P.M) „о as А-0 
h 
and 


[noctem а o as 0 


т t 


the Fourier series of f(x) is convergent to f(x) at the point x. 
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THEOREM 9 (Dini-Lipschitz). If f(x) is continuous and its modulus 
of continuity w(6) satisfies the condition 


аш -0 as 0-0, 


the Fourier series of f(x) is uniformly convergent. 
THEOREM 10 (de la Vallée-Poussin). Jf the function 


1 ft 
w= [ 04 


0 


is of bounded variation in some interval with left-hand end point t = 0 
and x(t) + © as t + 0, the Fourier series of f(x) is convergent at the 
point x to the value f(x). 

THEOREM 11 (Hardy). Jf 


Лх) =0 [С im) | 


and the coefficients c, of the series have magnitudes of the order O(n^ 5, 
where д > 0, the Fourier series is convergent at the point x to the value 
f(x) (see Chapter I, $ 3, sec. 8 regarding the symbols о(л) and O(n)). 


6. Biorthogonal systems of functions 
А biorthogonal system of functions on (a, b) is a system consisting 
of two sequences 


Pax), qx(x), Фәх), же qu), ыы | 
ve EE (4.44) 


satisfying the following condition on (a, b): 
(Pis yj) = 8, 
where ô; is the Kronecker delta (see Chapter П, $ 1, sec. 2). Here, 
b b 
the inner product (pj, +) is either | фару dx or f фир; do(x). In 
a a 


the latter case we speak of a system of functions, biorthogonal with 
respect to the weight o(x) or p(x), if do(x) = р(х) ах. 

Given any function, for which the inner products encountered later 
exist, we can associate with it the series 


ORTHOGONAL SERIES AND ORTHOGONAL SYSTEMS 195 


fG) ~ Ў Акб), (4.45) 
where Ак = (F, ui 


and consider the question of the convergence of the series and the 

possibility of using segments of it for approximation to the function. 
EXAMPLE 13. Chebyshev’s biorthogonal system on (— 1, 1) with res- 

pect to the weight p(x) — 1 is 

sin (k + lop 


a(x) = sign PET 


in (4.46) 
p(x) = 1 у ud) d ' 
* 2ай d sing 
where х = с05ф (К=0,1,2,...), 


> 


while d in (4.46) runs over all odd divisors of k+1, including d = 1 
and d=k+ 1 if this is odd; the function sign x was introduced in 
Chapter І, $ 2, sec. 1; u(d) is the Möbius function, i.e. 

В) = 1; 

u(a) = 0, if a is divisible by a square different from unity; 

ща) = (— 1)”, if a is not divisible by a square different from unity, 

and r is the number of prime divisors of a differing from 1. 

The functions p,(k) of this system are piecewise constant, while 
р(х) are polynomials in x having К simple zeros in (—1, +1). The 
first few functions of this system are given below: 


Фо = 1, фо = т, 


-1 for -1-«x-«0, 
+1 for 0-x-«l, 


—1 for -Il<x< =>, 
1 1 1 
фух) =} +1 for -5 х=, y(x) = 20-5) 


—1 for == 1 
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E 1 
—-1 in (^^ -) 
А 1 
Pg n 
Фәх) = | 1 
-1 в (o) 


+1 


p(x) = 2х(2х— 1). 


Б 
os 
У 
ird 


EXAMPLE 14. Markov's biorthogonal system in (—1, +1) with respect 


to the weight р(х) = 1/1—x? is 


Фо = 1, Po = 
(4.47) 


Pr = sign cos kp, Ph = 
where x = cos g, d in (4.47) runs over all add divisors of the number 
k that do not contain square factors, and д is the number of prime 
factors of the form 4m+ 1 contained in d (m ; 0) (see Chapter I, 
$ 2, sec. 1, regarding the function sign x). 

Here, as in the Chebyshev system, p(x) are piecewise constant, 
while y,(x) are polynomials in x. The first few functions of this system 
are given below: 


1 
Фо = 1, YP = п? 
_{-1 in (-1 0) 2X 
p(x) = | 4i in (0,1) рх) = 2? 
+1 in (-+ E 
2 
~1 in NAMES Gye Low 
Ф/х) = 2 , 5 Ы y» zi 2 > 
А 1 
+1 in (=. 1), 
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2 ЕД 

Series іп Chebyshev and Markov functions are similar to series in 
sines only or in cosines only. 

On passing from polynomials and the interval (—1, +1) to tri- 
gonometric sums and the interval (—л, +7), we can combine both 
systems into one, which generates series corresponding to trigono- 
metric series of a general type. 

A biorthogonal system is called a Chebyshev—Markov system with 
respect to the weight o(x), if р(х) is a polynomial of degree К, and 


ръб) = sign Q,(x), 
where Q,(x) is a polynomial of degree k. 

THEOREM 12. The biorthogonal Chebyshev-Markov system for a 
given function o(x) is unique; the polynomial Q,(x) appearing in the 
expression for р(х) is the polynomial of degree k with first coefficient 
1 for which 


f 10.9140 = min [| |591 409. 
ae Pi) | 1 


The system of polynomials (х) is determined after this by means 
of a process similar to the Schmidt orthogonalization process (the 
metric of space LL, is the natural one when considering series in the 
Chebyshev—Markov system). 


+1 in ($ ), 


$ 3. Orthogonal systems of polynomials 


Various systems of orthogonal polynomials were introduced by 
Legendre, Jacobi, Chebyshev and other mathematicians The first of 
these historically was the system of Legendre polynomials. Chebyshev's 
studies laid the foundationsofthe general theory of systems of ortho- 
gonal polynomials. 
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Let the system 
Р(х), Р(х), .... Р(х), ..., (4.48) 
where P,(x) is a polynomial of degree п, be orthogonal оп (а, 5) 
(in particular, the interval may be infinite) in the sense that 
b 
Pm Pa) = | Р(хХ)Р„(х) do(x), (4.49) 
а 
where o(x) has an infinite number of growth points (in particular 
do (x)= p(x)dx, where p(x) is integrable in (a, b)). Apart from a constant 
factor in the polynomials, the system (4.48) can be obtained by means 
of orthogonalization (see § 2, sec. 3) of the system of functions: 1, 
Xp Xy s. X”, o.. Let us agree to write Р(х) in future for polynomials 
of orthogonal system (4.48) defined by the condition that their first 
coefficient is equal to 1: 


Р(х) = 1, Рх = х+ао ... 


22 (4.50) 
sers PX) = X as ах 1+... Баһ, о 
апа P,(x) for polynomials of the orthonormal system, i.e. 
b a 
| P2(x) do(x) = 1. (4.51) 
a 


The Fourier coefficients of f(x) in an expansion in polynomials 
{P,,(x)} have the form 


Е | ” ОБ, (x) dolx). 
Tn particular, if do(x) = G(x) dx, we have 
ЕЕ | ° СОБ, (xd de, рО) = Лобо. — (452 


Notice, that, to evaluate integral (4.52), it is not necessary to find the 
values of P,(x) throughout the interval. On writing 
9-9) = | EdE апа for ims 91-00) = | 7 PAE dt, 
a a 
we obtain, by integration by parts, 
с = ФБР, (b) — pADPR (b) +... H DAPO. 
Therefore, to find the coefficients cy, су, . . ., Cm we only need to find, 
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by successive integration of p(x), the values of pb}, pAb), ..., 
qf" (b), the values of the polynomials P,(x) (К = 1, 2,...,m), and 
their т derivatives (for К = 0, 1,..., m) at the point b. 


1. Zeros of orthogonal polynomials 


THEOREM 13. The n-th degree polynomial Рх) of the orthogonal 
system (4.48) has n real distinct simple roots, all of which lie in (a, b). 

THEOREM 14. The zeros of the polynomials P,(x) and P, (x) of 
system (4.48) alternate: between any two zeros of P,(x) there is a zero 
of P, (*)- 

It follows from Theorem 14 that Р(х) and P, ,(x) have no common 
Zeros, 

THEOREM 15. If A(x) is the number of changes of sign in the series 
P(x), Р(х), ..., Р(х), the number of roots of the polynomial Р(х) 
in the interval (a, В) is equal to the difference A(a) — МВ) (the property of 
so-called Sturm systems). 


2. Recurrence relations for orthogonal polynomials 


Let P, +20), P, 41), Р(х) be any three successive polynomials of 
system (4.48), satisfying condition (4.50). In this case the following 
relationship holds: 


Р, а(х) = (халз) Ра: C) A PhD, (4.53) 


where the parameters &, ,, and A,,, are given by: 
b 
PRs 1(x) do(x) 
a - 


ны 
| 21.109 йо) 

uH (4.54) 

| Ра (х) @ 


Aner = pasa a ee 
| Р(х) 0) 


а 


Obviously, А, > 0. 
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The parameters «,,, „, 4, уу are expressiblein terms of the coefficients 
of polynomials Р, Pay Ри. If 


= k-1 » 
Py) = х®+ У ayxi, 
ј=0 
then 
Xn+2 = Angi, п Into, n1 


Даф = (n41, n-17 +20041, n 7 Олз, w 


It follows from formulae (4.54) that, if (а, 5) is a finite interval, 
we have for ali n: 


where 
а < Gig < Б, | 
О = angi = ©, (4.55) 
where с? = тах (|а|, |Ь]|). | 


For examples of such recurrence relations see $ 4, sec. 5—10. 


3. Power moments. The expression of orthogonal polynomials in 
terms of power moments 


The numbers 
b 
"e | хч адб) (4.56) 
а 


are called the power moments of the weight o(x). 
In the case of the system 


|e en, corre 


the pair-wise inner products are expressible in terms of the power 
moments: 


b 
и, x") = Í утуе дох) = ism: 
a 


Gram’s determinant of the system of powers is i 


Bie MN ES E #0. (4.57) 
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The process of orthogonalization of a system of powers yields the 
expression for the polynomials P,(x) of (4.51): 


> 1 
BG) = | а Hn я |, (4.58) 
" NAE MU 
Un Mati +++ [©п-1 x 
and for the polynomials P.) of (4.50): 
i Ho s т 1 
те An (4.59) 
"n-li...-.-.2^.2^.2^2^25»2 
Hn +++ Hanoi № 


The parameters « and À of the recurrence relation (4.53) can also be 
expressed in terms of the power moments: 


Ko e И Ит+2 
1 Hio =.. Ит Kny | 


Ho +++ Шп-1 Hne 
1 Ha +++ bn Ип+з А (4.60) 


A pter К eas 
Un «+. Изт-т 2041 
where п = 0, 1, 2,...; 
йл Antin- 
а=, dp eet arm (п= 0, 1, 2,...), 

while 4_, = 1. 
4. The connection between orthogonal polynomials and continued 

fractions 

The fraction 


PaO- P.) 
1-х 
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isa symmetric polynomial of degree n— 1 in ż and x. Hence the function 
Pu f. 
R, = f Pa Fr аң) (4.61) 
» = 


is a polynomial of degree n—1 in x. 

The polynomials R,,, ,(x), R,(x) and R,. ,(x)satisfy the same recurr- 
ence relation (4.53) as polynomials P, uu. Ppa), Р(х). This 
fact indicates (see Chapter V) that R,_,(x) and Р(х) are respectively 
the numerator and denominator of the mth order convergent of a 
Chebyshev type continued fraction: 


А, А i 
IIS ШЕ ы ышы ы ss 
x=% X>% X—ðn41 


(4.62) 


The polynomials R,. ,(x) are described as polynomials of the second 
kind with respect to the weight o(x). They are the denominators of 
the continued fraction 


Е. Se ee Sea „у. (4.63) 
XO  X—U, X— an4 


and are orthogonal with respect to some other weight. 

If the interval (a, b) is finite, the sequence RaP of conver- 
gents of the continued fraction (4.62) is convergent for all x lying 
outside (a, b) to the value of the integral 


f 20 (4.64) 


a*-! 


When the interval (a, b) is infinite, the continued fraction (4.62) 
is not always convergent. The question of its convergence is related 
to the determination of the corresponding problem of moments. 

Regardless of the convergence, the continued fraction (4.62) is 
related to the integral (4.64) by the following property: the expansion 
of the convergent Ry GCO[P, бх) of (4 62) as a series in negative po- 
wers of x coincides as far as terms of the order 1/x*" (inclusive) with 
the series 


EA 


А а ona, Man (4,65) 


xm х2п+1 
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which can be obtained if the function 1/(x— г) in the integral (4.63) 
is expanded as a series in powers of 1/x and formally integrated term 
by term (the convergence of series (4.65) is of no consequence). 

A continued fraction of the Chebyshev type, possessing the above 
property, is described as associated (assoziierte, Perron, ref. 11) with 
the series (4.65). 

In the case o(x) = const, the continued fraction (4.62) can be trans- 
formed, for x < 0, into a continued fraction of the Stieltjes type 


1 1 1 1 

ах+а -F dX + +... 
such that the rth convergent of (4.62) coincides with the 2nth conver- 
gent of (4.66). In view of this, the expansion as a series in negative 
powers of x of the 2nth convergent of the fraction (4.66) coincides 
with series (4.65) up to and including the terms 1/x*". A fraction 
of the Stieltjes type, possessing this property with respect to the series 
(4.65), is described as corresponding to it (correspondierende, Perron, 
ref. 11). We know from the theory of continued fractions that every 
continued fraction of the Stieltjes type (with а„;#0) has a correspond- 
ing series, and every continued fraction of the Chebyshev type has 
an associated series. 

The converse problem is of great importance in analysis: transfor- 
mation of a previously assigned series in negative powers of x into a 
corresponding or associated continued íraction, yielding rational 
approximations for the function given by the series. 

Notevery previously assigned series has a corresponding or an asso- 
ciated continued fraction. A series possessing this property is described 
as seminormal. 

THEOREM 16. Тйе series 


(4.66) 


© у en 
ett tate 


is seminormal if and only if all the determinants 


Co Си NE] e Ch. os башт 
| С с, g € сз. с, 
фи = 1 2 п апа Yn = 2 3 п 
Сп] Cn +++ бол—2 Са] Cg +++ Cong 


are non-zero. 
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In this case, the coefficients of continued fraction (4.66) corres- 
ponding to this series are expressed in terms of ¢,, and y, as follows 


= _ _ Фа Фь+1фь 
а = ф y, = — ————,‚ lay S 7———— 


ФР, Ф+1%» i 
where фе = 1,4 = 1. 
The fraction (4.66) corresponding to the series can be transformed 
by a contraction (see Chapter V, § 1, sec. 3) into an associated fraction. 


5. The conversion of orthogonal expansions into a sequence of 
approximating fractions 


A problem can be posed similar to that of converting the series 
fo 0, 0e -fa. 
КИРЕ Кин. 


into a continued fraction 


EC NE А 
aX + Og -- aX d- ..., 


namely, conversion of the series 
(х) = PX сох), (4.67) 


where {w,(x)} is a system of functions orthogonal with respect to 
some weight in (a, 5), into a sequence of rational fractions of the form 


Ed ©) 
а (х 
сЕ ван (4.68) 
(х) [=] 


У Бох) 
& 


Here, in analogy with the conversion of power series into continued 
fractions the numbers a, and b, are chosen so that the first n+ 1 terms 
of the expansion of the fraction (4.68) in an orthogonal system {w,(x)} 
coincide with the same terms in the series (4.67). The fraction (4.68) 
will also be termed in this case the n-th convergent. 
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The problem of finding such a convergent is not solvable in the 
general case. However, the problem has a solution for certain systems 
namely those satisfying the relationship 


ex x) (x) = Ань y) + Вьоь(х) + Сок (х). (4.69) 


Numerous orthogonal systems satisfy (4.69), including in particular 
all orthogonal systems of polynomials, the system of trigonometric 
functions {cos nx}, of Bessel functions (J,(x)), and so on. 

The formal process of converting the series (4.67) into the fraction 
(4.68) can be accomplished for these systems as follows. The fraction 
(4.68) is sought as the nth convergent of a continued fraction of the 
form 

Zo Фо аа ох) Боз w(x) as . (470) 
1 + Вдох) EXC Ye ++... 


The requirement that the series (4.67) and the fraction (4.68) corres- 


pond can now be written as 


Р, (х) — 9.(х) b» Cay (X) = TP Ong x) + rea) +... 4.71) 


Comparison of the coefficients of like functions оох), ..., @,(x) 
in (4.71) leads to the following expressions for the coefficients о, f, 
Y; @=1,..., п) of continued fraction (4.70): 


de-2Cc. _ 
==! =A=, З= В, У = 0-0 


AC 
B, = BER Bami Fa P Cn улат? 
E КЕ | 
„= — EE Cni E Bn А ав yd 
de=) н 


(4.72) 
using these, we can find Р (х) and q,(x) from the recurrence relations 


Pp (x) = o Pa (X) + [0(х) + Bal Paal) + YnPn—al); 


4, 
409) = Onn a) + [004(2) + Buln 22) + Pana E 13) 
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where we have put 


g2= 0 4-1 = 0, Яо = 1, a(x) = 1, 
Р. = 0, Р у= С, Р = С Р(х) = С,+ Со (х) 


(here, Ans Bw» C, are the coefficients of relationship (4.69)). 

To obtain rational approximations of sufficiently rapid convergence 
by this method, an effective approach is often to employ expansions 
in an orthogonal system of Chebyshev polynomials of the first kind 
(see § 4, sec. 7). 


6. Orthogonal polynomials and quadrature formulae of the 
Gaussian type 


The formula 
| feo ао) = Y. АДФ) (4.74) 
a =l 


for approximate evaluation of the definite integral is called a quad- 
rature formula of the Gaussian type if the base-points x? (i = 1, 
..., п) and coefficients ДУ (i = 1, 2, ..., п) are chosen so that 
(4-74) is accurate when f(x) isany polynomial of degree not exceed- 
ing 2n—1. 

THEOREM 17. If (4.74) is a quadrature formula of the Gaussian type, 
accurate for polynomials of degree not exceeding 2n— 1, its base-points 


х@, җ,..., ht 


are the n roots of the polynomial P,(x) of the system of polynomials 
orthogonal in (a, b) with respect to the weight o(x), while the coeffi- 
cients A\™ are the coefficients in the expansion of the n-th convergent 
Rai) Pn) of the continued fraction (4.62) into a sum of simple 
fractions 

В, 1(х) Е n AP 1 


P,(x) E t xx 
Le. 
А) = Rar) (4.75) 


Вит) 
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Alternatively, (4-75) can be written as 


ap = | Pal dete) 
alt= xPO 


In the particular case do(x) = dx and [a, b] = [0, 1], (4.74) is 
the ordinary Gaussian quadrature formula, the base-points of which 
are the roots of the Legendre polynomial of degree n. 


7. The closure of ап orthogonal system of polynomials 


The necessary and sufficient condition for closure of a system of 
polynomials {P,(x)}, orthogonal in (а, b) with respect to the weight 
a(x) in the space Lhasa b) is that the problem of moments for 
the sequence of moments of the weight о(х) be determinate or that 
а(х) be its extremal solution (see ref. 7). 

The problem of moments for a finite segment [a, 5] is always 
determinate, so that orthogonal systems of polynomials with respect 
to any weight on a finite segment are closed. In particular, the sys- 
tems of Legendre, Chebyshev and Jacobi polynomials are closed 
(see $4). 

The problems of moments are determinate for the Laguerre weight 
(see $ 4, sec. 9) on (0, +), and for the Hermite weight (see $ 4, 
sec. 4) on (— œ, +09), i.e. these systems of polynomials are closed. 

Hence the Fourier series in orthogonal polynomials of a function 
f(x) of Li are convergent in the mean to this function in the case 
of ali the classical weights. 

А discussion of the convergence of series in orthogonal polynomials 
{P,(x)} at every point and of the uniform convergence requires 
asymptotic estimates of | P,(x)| as n + ee. 


8. Christoffel's formula. The convergence of Fourier series in 
orthogonal polynomials 


Let (2,09) be an orthonormal system of polynomials in (a, b) 
with respect to the weight o(x), and let f(x) be any function of the 
space L3..(a, b). 
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Let us write s, for the nth partial sum of the Fourier series of 
f(x) with respect to the system (P,(x)): 


s) = У c AQ. (4.76) 


If we make use of the expressions for the Fourier coefficients, 
(х) can be written as 


s = [Ло È AR.) aco. т) 
The expression А 
Kf, х) = DEO (4.78) 


is called the kernel of the integral (4.77). The following formula holds 
for the kernel: 
Eg s ncn п+1(0Р„(х) — Prat Palt) , (4.79) 


1 
m 1-х 


where n+: is given by (4.54). Formula (4.79), obtained by Christoffel 
forthe сазе а = —1,b = +1, до(х) = dx, and generalized by Darboux 
to the case of any weight, is known as the Christoffel-Darboux 
formula. 

Formula (4.77) and the relationship 


| : K,(t, x) do(x) = 1 


ü 


lead to a formula for the remainder of the Fourier series of f(x) 
in the system (P,(x)): 


b 
в) — Дх) = ii | PO t, (05,0) — 5,109 Ри] doce), 
(4.80) 
where 


TES 


t- 


The next two theorems, on the convergence of the Fourier series 
of f(x), follow from (4.80). 
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THEOREM 18. If all the polynomials P,(x) are bounded at the point 
x and the function p,{t) belongs to Ly (a, b), the Fourier series 


Ў e À) 
hed 


is convergent at x and 
Лод = CaP al). 


DEFINITION. The sequence of functions (x), Фз(х), ..., а(х), 

. is said to be uniformly bounded if there exists a constant M such 
that | p, (x) | = М for all the functions of the system. 

THEOREM 19. If the polynomials Р(х) are uniformly bounded оп 
(а, b), given any function f(x), integrable on (a, b) with respect to 
the weight a(x), its Fourier series in the system {P,(x)} is convergent 
to the value f(x) at every point x for which 


| " eft) dot) 


exists. 

The following theorems establish the convergence of the Fourier 
series of f(x) in an orthogonal system of polynomials {P,(x)}, having 
regard to the structural properties of f(x) instead of the properties 
of the system. 

THEOREM 20. If f(x) satisfies the Lipschitz condition with index 


х > —, 
fe) — Локо = M |x= x |8, 


then the Fourier series of f(x) т a system of orthogonal polynomials 
{P,,(x)} is convergent almost everywhere on (a, Б). 


b 
DEFINITION. The function L,(x) -| | K,(t, x)| do(t) is known 
а 
аз the Lebesque function of the orthonormal system {P,{x)}. 


THEOREM 21. Let f(x) be continuous and let its best approximation 
by polynomials of degree n 


E,(f) = inf max|f(x) - n(x)! 


Qx(x) (а, b) 
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satisfy the relationship 
(ху). En(f) — 0 as n - œ. 


Then the Fourier series of f(x) in the orthogonal system {P,(x)} is 
convergent, at x = xe, to the value f(x). 


8 4. Classical systems of orthogonal polynomials 


1. Pearson's differential equation 


The equation 


o _ Xo dox а(х) 
© Bot Bet Bt (= 303) m 


is known as Pearson's equation. Solutions of the equation are called 
Pearson functions. The equation was introduced by Pearson for rep- 


resenting empirical laws of distribution. When о = —1, a = 0, 
1 

ч : 5 К - axi 
Bo = 1, В, = Ё, = 0, the solution is the classical function e ? 


— the density of a normal distribution law. 

The weights of all the most important systems of orthogonal poly- 
nomials are Pearson functions. 

Jacobi's weight is . 


o(x) = (1- 3* 0 + х), (4.82) 


where А > —1, п> —1; 0(х) is defined on [—1, 1] and all its 
moments exist there. Pearson's equation for Jacobi's weight is 


(-2-(Q*2x 


us (4.83) 


Га = 
0 
Chebyshev's weight is a particular case of that of Jacobi, corres- 
1 


1 
ponding tod = =5:#=-5: 


(4.84) 


об) = 33 


1-xb 
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Pearson’s differential equation for Chebyshev’s weight is 


" 


о x 


ah IAE (4.85) 
Legendre's weight o(x) == 1 is a particular case of that of Jacobi, 
corresponding to 4 = 0, u = 0. Pearson’s equation for it is 
e 1 


5а туғ (4.86) 


Any Pearson function, having all moments, and for which the 
denominator A(x) in (4.81) has real distinct roots, is reducible to any 
of the above functions by means of a linear change of the independ- 
ent variable. 

When the denominator B(x) has multiple or complex roots, the 
Pearson functions may not be weights of an orthogonal system of 
polynomials, since not all moments exist on the interval on which 
they are defined. 

The Chebyshev-Laguerre weight: 

olx) = xe, where A> ~l, и> 0, (4.87) 
is defined on (0, + =). Pearson's equation for the Chebyshev-Laguerre 
weight is 
д-да 

х 


х 


Ou, 
"wd (4.88) 
Any Pearson function, having all moments on (0, + œ), for which 
the denominator f(x) in (4.81) is a polynomial of the first degree 
(Вь = 0), is reducible to this function by means of a linear change 
of the independent variable. 
The Chebyshev—Hermite weight: 


a(x) = e™ (4.89) 


is defined on (— ~, + =). Pearson's equation becomes 


£2 2x. 
e 
Any Pearson function, having all moments on (— œ, + х), for 


which B(x) = const. in (4.81) (f, = Ё, = 0), is reducible to a Cheby- 
shev-Hermite function. 


Ü 


212 MATHEMATICAL ANALYSIS 


Thus all the Pearson functions that can serve as weights of an 
orthogonal system of polynomials are reducible to one of the above 
basic weights. 


2. The differential equations for corresponding’ classes of 
orthogonal polynomials 


The polynomials of orthogonal systems whose weights are Pearson 
functions satisfy linear differential equations of the second order, 
to which various physica] problems often reduce — a fact that ensures 
their importance in applied mathematics. 

If the weight о(х) of an orthogonal system of polynomials satis- 
fies 

L Е их 
о Bot Ayx+ рых” 


then the nth degree polynomial of this system satisfies the differen- 
tial equation 


Воду" +1609 + P'GO]y' — yay = 0, (4.90) 


where y, = n [x - (n - Df;], and a(x), B(x) are as in (4.81). 
EXAMPLE 15. For Chebyshev's weight, 


ох) = x, о = 1, 
Bx) = 1-22, В, = –1. 

The equation for Chebyshev polynomials is of the form 
(1—2?)y"— ху + ry = 0. 


3. The expression, by means of the weight, of a polynomial of the 
nth degree belonging to an orthogonal system of polynomials 


Let us consider an orthogonal polynomial system with Pearson’s 
weight о(х) from (4.81). Let P(x) be the nth degree polynomial of 
the system, orthogonal with respect to the weight function o(x). 
We can write P,(x) in the form 


Рыб = Aay ру (Od). (491) 
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The formula was obtained by Rodrigues for Legendre polynomials 
(in 1814), while similar formulae were later obtained for other poly- 
nomials. Rodrigues’ formula was first published in the general 
form (4.91) in ref. 5. 

КА, = 1, the coefficient of the highest term іп P,(x) is 


an 
= [[ 6+6), (4.92) 
k=n+1 
while for x^^! it is 
~ _ 0 кп, ~ 
ba = a nő, Tan nds. (4.93) 


The coefficient of the highest term in the normalized polynomial 


is 
a = || CoD (4.94) 
n! f n 


4. The generating function of an orthogonal system of 
polynomials with Pearson's weight 


Let us take an orthogonal polynomial system (P,(x)), where P,(x) 
is defined by (4.91) with constant 4, — 1. 

The generating function of the system is the function (т, w) of two 
complex variables z and w such that 


i was X A0 эл, (4.95) 


THEOREM 22. Given any orthogonal system of polynomials {P,(x)} 
with weight function o(x), satisfying condition (4.81), there exists a 
generating function (4.95), which is given by 


.i | ow) 

о(2) l—wB'(w)' 

where &,, is the root of the quadratic equation 
E-z- wp =0 (4.97) 


that is close to z for small w. 


pz, w) = (4.96) 
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EXAMPLE 16. Let us find the generating function for the Legendre 
polynomials. 
Equation (4.97) becomes in this case 


w? LE- (zw) = 0, 
where 


& = (нан) 


is chosen in such a way that ё, is close to z for small w, і.е. 


1 
= + (-14 ef iwz An). 
Ew = zz (— 1+ УТ +4wz cav?) 


On applying formula (4.96) and putting о(х) = 1, we get 
1 


Z, W) = А 
pen JT T 4wz -4w? 


The derivatives of polynomials orthogonal with respect to Pearson's 
weight are also orthogonal polynomials with respect to the weight 


e = ew | ЗЕ ж}. 


(4.98) 


5. Legendre polynomials 


The first system of orthogonal polynomials was historically the 
system of polynomials with the weight function р(х) = 1 on [—1, 
+1], introduced by Legendre in 1785. 

We introduce the following notation: let L(x) be the Legendre 
polynomial, in which we have not fixed the factor, to an accuracy 
of which the system of orthogonal polynomials is defined, let L,(x) 
be the nth degree polynomial with highest coefficient equal to 1, 
and let Lo) be the normalized Legendre polynomial. 

Rodrigues’ formula is 

de- 


в (4.99) 


L(x) = А 
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Formulae (4.92)-(4.94) lead to the e for ых) and L(x:) 


LO = уу Geet (4.100) 
5 2п+1 1 
Ly) = F= 2 Qi de T gs р". (4.101) 
The explicit expression for а Legendre polynomial is 
[2] 
LX) = Аһ 2 (= OR C л—2А, (4.102) 


It follows from (4.102) that L,(x) is an even function in x when n 
is even, and odd when n is odd. 
A recurrence formula. For the Legendre polynomials, we have 
in (4.54): 
E _ (n+ 
"ach Ме = aene) 


Lax) = xL, ix) = (+D? j nla). (4.103) 


(2n +1) (2л +3 
Obviously, L(x) = 1, L(x) = х; we further obtain from (4.103): 


Tye) = (9—1), 
Lo) = 5 (59-32), 
Lo) - э; 05х*— 30x? +3), 


L,(x) = =; (315х5— 350х3+75х) апа so on. 


3i 
The continued fraction (4.62) for a Legendre polynomial becomes 
®-% э. их 
2.3 IY НЕЕ СТЕ ИРЕ 
ох х х 


The denominator of the nth convergent of (4.104) is L, (x). 
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The continued fraction (4.104) is convergent to In(x+1)/(x-1) 
at every point x lying outside [—1, +1]. 

The generating function. Let H(x, м) be the generating function of 
the Legendre polynomials (4.95); (4.98) now gives 


1 


H(x, wW) = =, 4.105 
бу) V1 $4wx + ди? ( ) 
and 
1 - ў 140) E). 
Jl44wx-r-4w? nao n! 
where 
LO = Ze- 
0 = дя 0 
or 


H(x, w) = 1—2xw 4 2(3x? — Dw? — 4(538 — 3x) + 
4 2(35x — 30x? 4-3) + 


The generating function of the Legendre polynomials is often 
written in the form 


1 
A(x, t) = —————————, where = —2w, 
Л —2хї+ 
so that 
<i proper -È BO), 


where /,(x) is given by (4.99) with A, = 1/5)! 
The polynomials L,(x) and L,(x) are expressed as follows in terms 
of 1,(x): 


La) = mw (х); 


а) = "ES, 


The polynomials /, (x) satisfy the recurrence formula 


(п+2)1,,2(х) = Qn + 3)xl, (xX) — (1 4- 0. (4.107) 


(4.106) 


1.0). 
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The differential equation for Legendre polynomials is 
(1—х®)у'' ~ 2xy' E n(n + у = 0. 


The integral form of Legendre polynomials. The polynomial 
1 d^ a 
Lh) = Олут Ga - 1) 
can be written in the form 


ho) = if (x +iJ/1— x? cos p)” dp (4.108) 


The integral in (4.108) is known as a Laplace integral (it has a real 
value for real x, in spite of the integrand being complex). The poly- 
nomials /,(x) are uniformly bounded on the segment of orthogonality 
[-1, 41]. 

It follows from (4.108) that 


IONS 7 (4.109) 
for 
[х= 1. 


A stricter inequality holds for points lying inside the interval 


(-1, +1): 
[x 1 
00 | = эя Nr (4.110) 


Turan’s inequality is 
(x) — I 1004 100) = 0 


fonzl,-l1sxsl. 
The following are expansions of certain functions in Legendre 
polynomials: 


1 


т 
жи 


h(x) + 
2n(2n— 2)... (2n—2k +2) 


+ G+) RICE RNC ES p eO) 
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xm 3 Lx) + 
n 2n(2n— 2)... (2n 2k +2) 
"A Gk +3) GT 3 ina 3). One ak ay 18100 
1 


ims 
= 
+ 


[а IL 


z ФОНО 
PACA 3 BARI E EDI 


"i1 
% 


hae |х|<1. 


= © 
jd 


s vis vla 


= 2k- 3)! 2k— Dt 
30 -È ae ты ье}, 
Ix] = 1, 


А л > ((25— 1)11\2 
arcsinx = т, (Sa) Lorn) har), [x] <1. 


The convergence of Fourier series in Legendre polynomials. 

THEOREM 23. If f(x) has a continuous second derivative т [—1, +1], 
it can be expanded as a uniformly convergent series in Legendre poly- 
nomials in [—1, +1]. 

By (4-106) and (4.109), we have the following inequality for nor- 
malized Legendre polynomials: 


бт ZH for |x] £1. (4.111) 


Formula (4.111) and the corresponding inequality for the kernel 


K,(t, x) of L,(x) give an inequality for the Lebesgue function (see 
$ 3, sec. 8): 


L,(x) = (п+ 1). (4.112) 
A consequence of Theorem 21 (see § 3, sec, 8) and (4.112) is: 
THEOREM 24, Every continuous function f(x), the best approximation 
of which satisfies the condition 


lim E(f) = 0 (4.113) 


can be expanded as a uniformly convergent series in [- +1] in 
Legendre polynomials. 

The following is a consequence of Theorem 23 and formulae (4.106) 
and (4.110): 
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THEOREM 25. A function f(x), the square of which is integrable in 
[—1, 1], can be expanded as a Fourier series in Legendre polynomials 
convergent to f(x) at every point x for which the integral exists: 


С 
РЕ 1-х А 


REMARK. Condition (4.114) is satisfied, in particular, if the finite 
derivative f'(x) exists at the point x. 

THEOREM 26. Let f(x) be a function, the square of which is integrable 
т [—1, 1], and suppose the left- and right-hand limits f(x—0) and 
f(x —0) exist at the point x In this case, if the integrals 


| Е = oy xxn (09а 
-1 


are finite, the Fourier series in Legendre polynomials is conyergent 
at the point x 2 [f(x —0) 4- f(x - 0)] 
THEOREM 27. If f(x) satisfies the Dini-Lipschitz condition in [—1, 
+1]: 
lim (6) In (6) = 0 
$ —>0 


(where (6) = sup {|Дху)—(Дх„)|} is the oscillation of 
[ximme[<d 
f(x) it can be expanded at every point of the interval as a Fourier 


Series in Legendre polynomials, the convergence being uniform in every 
segment [-1+h, 1—A] (А > 0). 


6. Jacobi polynomials 


The Jacobi polynomials are polynomials orthogonal in [—1, +1] 
with respect to the weight 


ex) = (1-7 х) Or xr, (4.115) 


where А> —l, и> —1. The weight function (4.115) is Pearson's 
weight (see $ 4, sec. 1). The above definition specifies the Jacobi 
polynomials apart from a constant factor. If this factor is not fixed, 
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we shall denote the polynomials by Л х); we write 741 (x) 
if the coefficient of x^ is unity, and 7% "х) if the polynomial is 
normalized. 

The Legendre polynomials (see sec. 5) are a particular case of 


Jacobi polynomials, with = u = 0. The case 4 = = ап 
д= р = -> are specially treated later (see sec. 7, 8). The poly- 


nomials corresponding to these values of 4 and p are called Chebyshev 
polynomials (of the second and first kind respectively). 

In general, the case А = д has certain special features, The Jacobi 
polynomials with 4 = и are said to be ultraspherical. 

Rodrigues" formula. Formula (4.91) gives for Jacobi polynomials: 


m 
JEP) = 109 ERD, (4.116) 
where we have for E Px): 
4, = (- 1" 


Г(А+и+п+1) 
аал аналі Д 117 
Tut +1)? un 


and for J (3): 


Á =(—1)° 2-О+и+әп+) TU t pe n 1) PO E ir 2n 1) 
n Itn) utni! — ^ 


(4.118) 


These formulae are suitable for n > 0. They are also true for n = 0, 
provided A+u+1 = 0; if A--u4-1 = 0, they lose their meaning 
at n z 0, though it is clear that 


Jf» = 1. 


An explicit expression. If A, = (—1)"/2"! in Rodrigues’ formula 
(4.116), we shall write j"(x) for the corresponding Jacobi poly- 
nomial. It is often convenient to discuss this Jacobi polynomial. 
For it, the following formula holds; 


JE Ox) = 
1 & a Гф+тп+1)Г(и+п+1) тасв k 
= ж С" Tank Tukey р © 
(4.119) 
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A recurrence relation. The general recurrence relation (4.54) for three 
consecutive polynomials of a system of orthogonal polynomials 
becomes, in the case of the system of Jacobi polynomials; 


ЈО х) = (хаа) JPG) — Angi 8х, (4.120) 


where 
Qa — 22 
бв = ип Е2)(4+й--2л+4) ’ 
Мы = (4+ п+1)(и+Еп-Е1)(42+и+п+1) 4+1) 
"u^ ПИЯ чи +2л-Е2 A + e+ 3) : 
(4.121) 

Since 

= = А-д 

мн) — (Мн ы ye 

Jj =1 and ЛЮ шу Irur?’ 


all the Jacobi polynomials can be obtained successively from (4.120). 
These expressions are very unwieldy, however; e.g. 


_ А-и Q- uy -0 0-4 
бэ B) = РТ 
Jf« вх) = x Ta CETE T Rd 4) 


and so on. The explicit formula (4.119) is more practical for their 
actual computation. Complete tables of Jacobi polynomials are 
available (see ref. 3). The Jacobi polynomials satisfy recurrence rela- 
tions, not only with respect to the parameter п, but also with respect 
to the parameters À and n, 4, u and п, these being consequences of 
Gauss's formulae for the hypergeometric functions; the Jacobi 
polynomials are a particular case of the latter. 

The generating function. Let I(x, w) be the generating function of 
the Jacobi polynomials (see sec. 4). Formula (4.96) now gives 

Date = 
I(x, w) = = (1-2 + 4/1 4х +4и? x 
(x, и) етте + / ) 
х (1-2%+ Л +4=х-Е4ә#®)7”_ (4122) 

апа 
= ОО) 


Ix, и) = Y 


zm n 


w^, (4.123) 
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where 


Jaw = 0-370437 = [1 х)б+") (14 х)в+"], (4.124) 


The generating function for the Jacobi polynomials is often 
written in the form 
2^*u ААА 

se (1 — 1 4+ 1 21-12 x 
М1= 2+1 У 
х(1+1+ J/1—2xtF E), (4.125) 

where f = —2w; the coefficients of the expansion in powers of t 
are now the polynomials jj (x) (see (4.119)). In the case of ultra- 
spherical polynomials (А = и), the generating function is simplified 
if we introduce, instead of polynomials (х), the polynomials 


Их, t) = 


г(«+1) гены A 
YO(x) = ЈК), where a=A +5, 
Г(2ә) Г ( +a +) 
in fact, 
d-i = Y уд, (4.126) 


n-0 


By using the ultraspherical polynomials уа, М. Ya. Sonin obtained 
an analogue of Taylor's formula: 


feta) = PTO) Ў (n n) Tast) яш У), (4127) 


where J,(x) is Bessel’s function, D = d/dx. 

A differential equation for Jacobi polynomials. Differential equation 
(4.90) for polynomials orthogonal with respect to Pearson's weight 
function, becomes, in the case of Jacobi polynomials: 


(1 — x9" + [(и— 2) - Qi At 2y]y' (2+ ал+ Dy = 0. (4.128) 


Inequalities for Jacobi polynomials and the convergence of the 
Fourier series. Given the condition 
с = шах (4 и} = -4 (4.129) 


the following theorems hoid. 
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THEOREM 28. The greatest value of the modulus of Je PX) is 
attained in the segment [— 1, 1] at one of the points x = +1. 

THEOREM 29. Given condition (4.129), the normalized Jacobi poly- 
nomials satisfy the relationship 


^ el 
|Д 00) = Ми * 
for ай |x| = 1. 
Here М is a constant, depending on А and д. 
It follows from Theorem 29 that the Lebesgue function of the 
Jacobi polynomials satisfies 


Lx) = Муй, 
which leads, in conjunction with Theorem 21 (ее $ 3), to 
THEOREM 30. Let о = d and let p be a positive integer not 


less than 2a--2. Every function f(x), defined in [—1, 1] and having 
a continuous derivative of order p, can be expanded as a uniformly 


convergent Fourier series in the polynomials Je PX), 


7. Chebyshev polynomials of the first kind 


Chebyshev polynomials of the first kind are a particular case of 

Jacobi polynomials (see $ 4, sec. 6), corresponding to Я = u = ->. 
ui ld 

The polynomials X 2°73) were first discussed by P.L. Cheby- 

shev in 1857, when solving the problem of the best approximation 

of continuous functions by polynomials. We shall denote them by 

T,(x); these polynomials were obtained by Chebyshev in the form 


T,(x) = cos (п атс cos x). (4.130) 


Formula (4.130) defines 7,(x) only on the segment [—1, 1]. But 
definition (4.130) can be extended to all values of x by means of the 
familiar trigonometric formula. 


cos np = cos" p— C2 cos"7? ф sin? ф + C3 cos"-* p sint p— ... 


(this completion of definition (4.130) will be assumed without making 
any special proviso in future). 
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The polynomials T,(x) possess many remarkable so-called extremal 
properties in addition to their general properties as polynomials of 
an orthogonal system; these extremal properties will be described 
after dealing with the general properties. 

Rodrigues’ formula is 


а 1 n 
T,(x) = А, 1— x? — : 4.131 
„оў = Ag V A т=з) (4.131) 
We shall write TG) for the polynomial with highest coefficient 
equal to unity, and 7,(x) for the normalized polynomial. 
Ап explicit expression. Formula (4.130) yields an explicit expression 
for the Chebyshev polynomials, where 


1 


T(x) = Bani COS (n arc cos x), 
7 (4.132) 
Т,(х) = fz cos (n arc cos x). 
Expression (4.130) can also be written in the form 
TO) = Го Т)" (х Jx-1)] 
9r (4.133) 


n 


2 n 
T(x) = >, (-1* Pra Ch ,2n-3h-lyn-ah. ) 


As follows from (4.130), the zeros of Т,(х) are the numbers 


х = cos HD (k=1,2,..., n. (4.134) 
The recurrence formulae 
Т, (х) = 2хТ„(Х)— Tn 23 (>), (4.135) 
Е = Iss 
Ti G9 = xTa - F Th- 0) (4.136) 


follow from (4.120) with 4 = u = >. Since То(х) = 1, T(x) = x, 
it follows from the equation (4.135) that 
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Т, (x) = 2х2—1, 

Т x) = 4x? 3х, 

T(x) = 8x*— 8x? +1, 

T; (x) = 16x5— 2028 + 5x, 

T, (x) = 32x95 — 48х + 18:2 -1 
and so on. 


In the case of Chebyshev polynomials, the continued fraction 
(4.62) becomes 


(4.137) 
since here, 
age us. Roos cum 
5 aviè t 4, : 
The denominator of the nth convergent of the continued fraction 
(4.137) is T,(x). The continued fraction is convergent, for all x 
outside the interval (—1, 1), to the function ajy xt—1. 
The generating function. The coefficient of t” in the expansion of 


1-2 


Tœ, Ò) = я (4.138) 
in powers of t is the polynomial T,(x): 
1-1? = 
T(x, t) = ТЕ = Ty*2 Y, Ty Or . 
The differential equation for Chebyshev polynomials is 
(1— x3y"' — xy’ + ту = 0. (4.139) 


Expansion of a function as a Fourier series т Chebyshev polynomials 
and the comparison of this with the expansion as a Maclaurin series. 
Wide use is made of Fourier series in Chebyshev polynomials T,(x) 
for uniform approximation of functions. Notice that the expansion 
of a function f(x) in [— 1, 1] as a Fourier series in polynomials T,(x) 
reduces to the expansion of f(cos х) in [—7, л] as a Fourier series 
in cosines. 
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For instance, 
et 008 9 — I (a)4-2 2 I,{a) cos ng, 
where J,(a) is Bessel’s function; hence the substitution x = cos ф 
gives 
ей = h(a)+2 > 1(а)Т, (x). 


An expansion may similarly be obtained for f(x) = x" from the 
familiar trigonometric formulae: 


1 n-1 
сов" g = m (5. 2C}, cos 2(n—k)p+ ch) , 


n-1 
cos?n-1g = m pa Ck,- cos Qn — 2k — 1)g. 


The substitution x = cos@ gives 
1 n=l k 
202" = 225 2Co Tan зһ X) T a.) , | 


ке, 1 "=, (4.140) 
xmi = т 2 Cin-iTan - 28-102. 


Similarly, expansions in Chebyshev polynomials ТУ follow from 
the expansions in cosines (with |x| = 1): 


|x| = 2.2 у ao р (4.141) 
Xd 2i (- pen Fanaa) , (4.142) 
cosax = Jala) +2 $ (—1)"Jon(2)Tan (х), (4.143) 
sin ax = 2 b» (= 1D Us (Tos б), (4.144) 


aec iàcC penat 1 (4.145) 
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e* = I(a)+2 Y, MATa), (4.146) 
n=l 


wa- -2È ERO alad (44N 


In general, if C, is the Fourier coefficient of f(cos x) in the system 
{cos пр}, we have 


С, = 2 [л ф) cos np dp= SE FOT) 
D 7J- 


dx 
„1-2 

Roughly speaking, when such functions are represented by the sum 
of a like number of terms, the limits of the accuracy are 29-1 times 
better for an expansion in Chebyshev polynomials than for a Taylor 
series. 


For example, when |x| = 1 follows from (4.146) that, in the case 
of f(x) = e™ with large л, 


. (4.148). 
л 


Cy = 2L(2) = Jp - 1 A abcr 


while at the same time 
f exo) Е a 


n! ni 


If we substitute the Maclaurin series for f(x) 


r (п) 
fG) = /®+/'@х+ 2. а +... ITO Ls, 
under the integral sign in (4.148), in view of the orthogonality of 
the polynomials 7,(x) and the expressions (4.138), (4.140), we get 
an interesting connection between the coefficient C, in the expansion 
of f(x) in Chebyshev polynomials and the corresponding coefficient 
of Maclaurin’s formula for f(x), viz 


EN! SMO)  fGe2(0) fev) 
Ca = | m targi Т (42i e) (4.149) 
It follows from (4.149) that, if the principal part of f™(0)/n! +...) 
reduces to / ?0)/n! for large n, we have 


1 feo 


ye 


m2 n 


(4.150) 
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It follows from (4.150) that, given |х| = > the expansion of a 


function as a Maclaurin series is in general better, whereas the expan- 


sion in Chebyshev polynomials is better for >= [х| = 1, since 
0 
шах |C,7,(x)| = Im E | тах LO л . 
т <1&1&1 


The convergence of Fourier series т Chebyshev polynomials. In view 
of the fact that 
17,0) = 1, 


it follows from Theorem 19 $ 3 that: 

THEOREM 31. Given any function f(x), integrable in (—1, 1) with 
respect to the weight \//1—x?, its Fourier series in the system {Т„(х)} 
is convergent to the value f(x) at every point x for which the integral 


1 Д-ДО _ at 


-1 x-t XJl-f£ 
exists. The Lebesgue function of the system of Chebyshev polyno- 
mials satisfies the inequality 


Lx) = 2 *lnn. 


We therefore have (see Theorem 23 § 3): 

THEOREM 32. Every function f(x) for which 

lim E,(f)In n = 0, 
п> ое 

сап be expanded as a uniformly convergent series т Chebyshev poly- 
потаб. 

The extremal properties of Chebyshev polynomials. 

THEOREM 33 (Chebyshev). Of all the polynomials with highest 
coefficient equal to unity, the polynomial Т, «CO has the least deviation 
from zero, i.e. 


max |T,G)]- тах 10462! 


-1Zx21 


Jor all polynomials Q,(x) of degree n, having highest coefficient equal 
to unity. 
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COROLLARY. Since 


= 1 
max |Т„(х)| = 22-1? 
1 


mq 


we have for any polynomial Q.(x) with highest coefficient equal to unity: 


max 10.691 = ет. 
-1ZxZ1 

The following interpolation property of the zeros of a Chebyshev 
polynomial is a consequence of the theorem. Suppose we form, with 
respect to the points xj, X», ..., x, an interpolation polynomial 
Q,~1(x) of degree n—1 for a function f(x), n times differentiable 
in [—1, I]. The remainder term of the accurate interpolation is 
now given by 


R(X) = Дх) – Q0) = 


where 


LOG) 


n! 


(х— ж) (х—х›)...(х— Xn), 


Xi < Xin, and  £e€(x ха). 


If the interpolation base-points ху, x», ..., x, are zeros of the Cheby- 
shev polynomial T,(x), then 


шах |(х—эу)(х—х)...(Х—»хм)| 
x€{-1, 1] 
has a minimum value. 

Thus, if the coefficient of f™(€) in (4.148) changes only a little in 
relation to the variation of x in (— 1, 1), the interpolation base-points 
which are roots of the polynomial Т,„(х), yield the least value of the 
remainder term. 

THEOREM 34 (Chebyshev). Of all the polynomials Q,(x), subject to 
the condition Q,(£) = М, where |& | = 1, the polynomial MT,(x)/T,(&) 
deviates the least from zero in the segment [-1, 1]. 

THEOREM 35 (А. A. Markov and V. A. Markov). Jf the polynomial 
Q,(x) satisfies, т [—1, 1], the inequality 


10,(x)| = M, 
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the derivative of order k of this polyomial satisfies in [—1, 1] the 
inequality 
n(n — 1)... p —(k—1y] 


IOP = М тазоду ° 


(4.151) 


the sign of equality being obtained іп (4.151) only for the polynomial 
T,(x) at the points x = +1. 


8. Chebyshev polynomials of the second kind 


The polynomials of the second kind with respect to the weight 


1/V1—x? (see $ 3, sec. 4), i.e. the numerators of the convergents of 
the continued fraction (4.137), form an orthogonal system in [— 1, 


1] with respect to the weight o(x) = /1— x? and are therefore the 
Jacobi polynomials corresponding to A= p = >. They are known 


as Chebyshev polynomials of the second kind. We shall denote them 
Бу U,(x). - 

Тһе Chebyshev polynomials U,(x) and T,,,(x) are connected 
by the relationship 


U,(x) = С, x Tay. (4.152) 


An explicit expression for the polynomials. We have from (4.152): 


sin (2+ 1) arccos x] 


J1-x 


Formula (4.153) defines U,(x) only in the interval (—1, Г), but this 
definition may be extended to all x by means of the familiar trigono- 
metric identity 


U,(x) = С, (4.153) 


sin(n + Dp = sin*** p— C2,, sin"! pcos? p+ 
+ Cfa sin"? p cost g— .... 


In U(X), let the coefficient of x" be unity, while Up ll = 1, 
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Now, 
sin [(n + 1) arccos x] | 


J1- x3 | 

А 2 sin [(n-- 1) arc cos x] 

Ох) = |- =. 4.155 

CERE Л 9 
Recurrence formula. Аз the numerators of continued fraction (4.137), 

the polynomials U,(x) satisfy the same recurrence relation as T, | (x): 


T,(x) = E (4.154) 


баб) = xU (9) — 0,09, 


where Uo) zl U(x) = x; hence 


р 1 
U(x) = #—-ү› 
= 1 

U;(x) = #—-ух, 


= 3 1 
ds 2i 
Ux) = x zeti and so on. 
A continued fraction for polynomials U,(x). These polynomials 


form an orthogonal system with respect to the weight о(х) = y1— x? 
and are in turn the denominators of the nth convergent of the conti- 
nued fraction 


D. (4.156) 


The numerators of the nth convergents of the continued fraction (4.156) 


are U, (3. For all x lying outside the segment [—1, +1], the con- 
tinued fraction is convergent to the function 


До = (x— J58— 1)n. 
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Fourier series in Chebyshev polynomials U,(x). The following 
inequalities hold: 


i61» [Ren (-lsxs 1), 
5 1 (4.157) 
10491 (2 — (-l<x< 1) 


The next theorems are consequences of (4.157) and the general 
theorems (see § 3, sec. 5). 

THEOREM 36. Every function, having a continuous derivative of the 
third order, can be expanded as a uniformly convergent series in poly- 


nomials U,(x). 

THEOREM 37. Every function f(x) of Ljyzæ(—1,1) can be expanded 
as a Fourier series in the orthogonal polynomials Ü,(x) at every point 
x, and for every f(x) the following integral exists: 


f (ew -KÀ y JSP d. (4.158) 
-1 


THEOREM 38. If a function f(x), defined on [—1, 1], satisfies the 
Dini-Lipschitz condition 


lim (6) In д = 0, (4.159) 
$-90 ^ 
it can be expanded in the interval (—1, 1) as a Fourier series in poly- 
nomials U,(x), the convergence being uniform in any interval (—1 + 
+h, 1-№). 


Given suitable convergence conditions, (4.152) enables us to diffe- 
rentiate the expansion 


Дх) = >. nT, (X) (4.160) 
ne 
term by term, to obtain the expansion 


Л = Y na Uni). 
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Expansions (4.139 —4.142) given above in polynomials T, lead to 
the following expansions in polynomials U,: 


2 => 
e» = — >, nL(a)Us -1(х), 
а nei 


. _4 < 210 (X) 
xc. X Bl 
sin ax = = » (— D 2nJ,, (a) U 1X), 
а n=l 
2 со 
созах = т 2 (— 1841 (2л — IJgn-1(QU а-1)б0) 
næ К 


апа ѕо оп. 


An extremal property of polynomials U,(x). 


THEOREM 39 (Chebyshev). Of ail the polynomials Q,(x) of degree 
n with highest coefficient equal to unity, the least value of the integral 


f 10.091 dx 
-1 


is given by Q,(x) = Ох). 


9. Laguerre polynomials 


The polynomials orthogonal in the interval (0, + œ) with respect 
to the weight function o(x) = x*e^* (x > —1) are usually called 
Laguerre or Chebyshev-Laguerre polynomials. 


These polynomials were first encountered in the case х = 0 in 
the analytical mechanics of Lagrange, then in Abel’s posthumous 
papers. Chebyshev discussed the polynomials in 1859, and for them 
obtained a recurrence formula and an expansion as a continued 
fraction; it was only in 1878 that they were considered by Laguerre. 
The case of any ж > —1 was first discussed by Sokhotskii. 

Some authors only speak of Laguerre polynomials in the case 
æ = 0, and refer to generalized Laguerre polynomials when х з 0. 
We shall denote the latter by Z7(x). 
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Rodrigues’ formula is 
а" ©: — 
L3(x) = Ах “ея ds (x1ng77) (4.161) 


The polynomial E(x) with highest coefficient equal to unity is 
obtained from (4.161) with 4, — (—1)", while the normalized 
L(x) is obtained with 
(– 0" 
Аһ =. 
nM Yi --n 4-1) 


A recurrence formula: 
Те (х) = (x—a—2n—3)Iz,,0)— (1+1) (n+ +1) Lax). (4.162) 
In the case х = 0 this reduces to 
Т, (о) = (х—2я—3) Li) - 014-1? Za (9, 
from which we find, using Гох) = 1, L4(x) = x—1, 
Іх) = x-4x42, 
L(x) = x:—93?..18x— 6, and so on. 


А continued fraction for polynomials L(x). In the case х = 0, the 
continued fraction (4.162), of which the denominator of the nth 


convergent is ЖЕ takes the form 


phe, WE PAS et (4.163) 


х—1—х—3—х—5—х—7—.... 


The continued fraction (4.163) is convergent for all x not lying in 
(0, + =) to the function 


оо e~t 
vies) = f PET dt. 


The continued fraction for any х, 


IY(a--I) +1 2(« +2) 3(x +3) са 
x— (x+ 1)—x—(x4-3) — х– (0+5) -х- (x +7) (4.164) 


is convergent for any x not lying in (0, + œ), to the function 


fix) = | ешеш. 
0 


x-t 
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A differential equation for L*(x): 


xy" +(@+1—x)y’ +пу = 0. (4.165) 


Sokhotskii obtained a formula for the power x” in terms of Laguerre 
polynomials: 


п Iz. (x) 
п = 1 QE m RA. 
x Г(п+а+ ÈT RED 
The generating function is 
ELM оо (_ үүпүпү@ 
a-i- T = $ Eureca, (4.166) 


п=0 
Formula (4.166) was first obtained by Sokhotskii. The generating 
function can also be written in the form 
-ЬОАЛх) абд" 
(itx)  n=o п! Г(х+п+1) 
where J,(z) is Bessel's function. Formula (4.167) was obtained by 
N.Ya. Sonin. Sonin also obtained the relationships 


1 dead) т de 
a+) Em E = LQ) ——3j-—— > 


Palt, х) = e (4.167) 


natal (ха E (4.168) 
“тт Т pa “т á 
x 


Closure of the system {L*(x)}. The problem of moments for the 
sequence 


ln = | е-*х°+һ dx 
0 


is determinate, from which it follows, by Riesz's Theorem, (see $ 3, 
sec. 7) that the system (L;(x)) is closed in the space Lt. „а (0 + ео). 

The Laguerre polynomials can be obtained from the Jacobi poly- 
nomials j^? by means of a passage to the limit: 


Хх) = dim jf »(1-2) (4.169) 
ш оо HB 
(K. A. Posset's formula). 
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10. Hermite polynomials 


The polynomials, orthogonal on (— о, + e») with respect to the 


at 
weight о(х) = e ? c are known аз Hermite polynomials. This 
name is sometimes given to the polynomials orthogonal with respect 
to the weight e7*, Such polynomials are first encountered in Lap- 
lace's works, then in those of Chebyshev (1859). Chebyshev obtained 
a Rodrigues’ formula and an expansion as a continued fraction. 
They were considered by Hermite five years after Chebyshev. Ro- 
drigues' formula is 
x? gn ( -2 
Hx) = Ane? +5 (6 z), (4.170) 
when 4, = (— 1)" we get H,(x) — the polynomial with highest coef- 
ficient equal to unity; when 4,= (—1)"/ Jn! {Гол we get the normal- 
ized H,(x). 
The recurrence formula is 


Н, 10) = Hp) - n, (0); (4.171) 
since Hx) = 1, Нух) = х, we get 


Нух) = 2-1, 

Ну(х) = x8 — 3x, 

Нух) = х- 6x2 +3, 

Н.х) = х5 — 103 +15х, and so on. 


The generating function is 


Nd -H n 
£x. y EE, (4.172) 


neo п! 


The continued fraction (4.62), of which the denominator of the 
nth convergent is the polynomial H,(x), is 

Куз 

CD (4.173) 


123 
—x-x—-x-.. 
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Fraction (4.173) is convergent for all non-real x to the function 


| LM 
wes et 


A differential equation for the Hermite polynomials: 


y'—xy' tny = 0. (4.174) 


The polynomials H,(x) can also be obtained from the Jacobi 
К x) as A+ оо: 


polynomials Л, 
Hy(x) : 2, x 
a = lim | A *Д® —)]. 4.17 
л! т | ds (=). T 


Closure of the system of Hermite polynomials. The problem of mo- 
ments for the sequence 


= _ 
иһ = хе 2 dx 
is determinate. Hence it follows by Riesz’s theorem (see § 3, sec. 7) 
that the system {H,(x)} is closed in the space L? , E (— =, + ә). 
e T 


11. Chebyshev polynomials, orthogonal on a finite 
system of points 


In a paper of 1855, "Continuous fractions" (O nepreryvnykh 
drobyakh), and in certain other works, Chebyshev considered the 
expansion of the sum 

y (x) 


92(х;) = т 
2-х, (x) i 


as a continued fraction and investigated the properties of the denomin- 
ators of its convergents. 

If o(x) is a step function with growth points x, xs, . . ., xy, the jumps 
at which are equal to m, Ms, ..., my respectively, then 


S Өх) _ | ^ а(х) (4.176) 


і=12— Xi gs 2-x' 
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The denominators of the convergents of the continued fraction (of 
type (4.62)), corresponding to integral (4.176), are now polynomials 
orthogonal with respect to the weight function o(x). 

The orthogonality of P,(x) and P,(x) with respect to o(x) implies 
in this case that 


> OX xP (x) Pax) =0 5 94 К. 


The continued fraction (4.62) is now finite, the system of orthogonal 
polynomials is also finite and contains precisely № polynomials P(x), 
Р(х), ..., Py, (х). Chebyshev applied the results of his investiga- 
tions to interpolation by the method of least squares which consists 
of the following. The values of the function f(x) are specified at the 
points xj, X, ..., xy. Among all the polynomials of a given degree 
п < №, we have to find the polynomial Q,(x) such that the sum 


Y Ux) — Qn)? (4.177) 


is a minimum (see $ 1, sec. 3). 
Let 6°(x,) = 1 in (4.176); then 


N со 
à Іх) – „(ХР = (А) — 040)? ао(х). 

And, as follows from $ 2, sec. 4, (4.177) takes its least value when 

О„(х) is the nth segment of the Fourier series of f(x) in a system of 

polynomials orthogonal with respect to the weight function o(x). 

Using a system of equidistant base points on the segment (0, I]: 


х= (i= 1, 2,...,N). 


Chebyshev formed an orthogonal system of polynomials {6(x,)* = 1}. 
These are also known as Chebyshev polynomials. We shall denote 
them by P, y(x) (the polynomial of degree k in the system (x, = 


Py, n(x) = 1d ax E ax(x— 1)+@х(х— 1) (x-2) +... 
... +аьх(х—1)...(хХ—К-+Е1), 
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where 
asd (7 СС 1 
8 nn—l)...(n—s41Y 


In particular, 


Po, м(х) =1, 


x(x— 1) 


x 
Pa n(x) = 1-6 Ft NNI р 


х(х- 1) 
NN-1) 


x(x—1)(x—2) 


20 NUN — 1) (N — 2 " 


Py we) = 1—12-у+30 
х(х— 1) 

NN-n' 

x(x—1)(x—2) 70 x(x—1)(x—2)(x—3) 
NN-D(-2) * "^ NN-D(Q-2(-3)' 


Р, n(x) = 1-20 +90 
N 
—140 


x(x— 1) 

NN-U0 ^ 

x(x— 1)(х—2) +630 x(x—1)(x—2) (x —3) E 
N(N— 1)(N—2) N(N— 1) (N—2) (У 3) 

Җ(х-— 1) (х— 2) (х— 3) (x-4) 
ММ — 1) (N~2)(N ~ 3) (N— 4)’ 


P,, n(x) = 1-30 +210 
— 560 
—252 


and so on. The interpolation polynomial of degree m with respect 
to the system base points {х; = ИМ} for f(x), defined by the method 
of least squares, is the segment of the Fourier series of f(x) of order 
m with respect to the system (P, y(x)}: 


О.) = Ў СиРь мб), 
k=0 


where 


Ch = |. ЛӘР, м(х) do(x) = Ў, Лх), убх). 
o T. 
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The expression for Су does not depend on the degree of interpo- 
lation m. On increasing the degree of the interpolation polynomial 
new terms are simply added: 


От+1(х) = От(х) + Сл+1Рт+1, n(x) . 


Chebyshev showed that the case when o(x) is continuous can be 
obtained by means of a passage to the limit from the case when 
о(х) has a finite number of growth points. 

In particular, the Legendre polynomials can be obtained from the 
polynomials P, p(x) аз N — e». If L,(x) is a Legendre polynomial, 
normalized by the condition that L,(1) = 1, we have 


L,Qx—1) Е (к=1,2,..5. 


CHAPTER У 


CONTINUED FRACTIONS 


Introduction 
1. Notation for continued fractions. Basic definitions 
An expression of the form 


а 
b a 
b, 42 

1 +ъ, +. 


ta oles 
TT 
b.c. 
is called a continued fraction. 


In view of the unwieldiness of the above method of writing, several 
authors have proposed different methods, for instance: 


bot tet... Ho te, Pringsheim 
"IRSE Ure D POEM 
a . а; . + а, . xd 
Pot tp T oh eas (Miller) 
е ен а, on > (Rogers) (5.1) 


bit b oA 


We shall use the last notation. Pringsheim also proposed writing a 
continued fraction in the form [%; a,/b,]r. If a,, and 5, in frac- 
tion (5.1) follow a different law to the remaining a, апа b,, Pringsheim 
used the notation [%; a,/b,, ав. 

The fraction a,/b, is called the n-th partial quotient of the continued 
fraction (5.1); a, and В, are the terms of the n-th partial quotient; 
dj, а», аз... are called the partial numerators of the continued 
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fraction; b, ba, bs ,... are its partial denominators; by is called the 
zero partial quotient. | 

All the terms of the partial quotients will be assumed finite; all 
the partial denominators are usually assumed to be non-zero. 

A continued fraction having a finite set of partial quotients is 
described as terminating. 

A continued fraction having an infinite set of partial quotients 
is described as non-terminating. 


2. A brief historical note . 


Algorithms similar to continued fractions were employed even by the mathe- 
maticians of antiquity (Euclid's algorithm, the Archimedean approximation to J. 
Of the médiaeval mathematicians, Omar Khayyam (c. 1040—1123) came close 
to continued fractions when trying to generalize Euclid's algorithm to the case 
of incommensurable magnitudes, but continued fractions as such first appeared 
jn the "Algebra" of the Italian mathematician R.Bombelli, published in 1572. 
А number of outstanding mathematicians of the seventeenth century, including 
J. Wallis and Chr. Huygens, occupied themselves with continued fractions, but 
the founder of the theory of continued fractions as an independent branch of 
mathematics was Euler. Almost all the great mathematicians of the eighteenth 
century and the first half of the nineteenth century made some contribution to 
the development of the theory. Interest has recently returned afresh to continued 
fractions, owing to their great theoretical and practical value. In particular, con- 
tinued fractions are employed in various approximate computations. For instance, 
with their aid we can compute approximately the values of many functions, the 
power series expansion of which are slowly convergent or even divergent. 


$ 1. Continued fractions and their fundamental properties 


1. The evaluation of convergents. Convergents 


The terminating continued fraction 
а а, а Р. 
b, Ao n en 
ОР +b +... tbn Oa 
is called the nth convergent of the continued fraction (5.1). We put 
here 
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Basic recurrence relations: 
Pa = В.Р: НР, 
Qn = OnQn-1 + FnQn-2 


Equations (5.2) enable the convergents to be evaluated successively. 
It is useful here to employ the following scheme: 


(п = 1, 2, 3,...). | (5.2) 


а а аһ 
br 5 e ; 
OT by bby Tb. 
Dh A OA № 
01 О, Q Qi 


EXAMPLE l. 


Е р ais dee 


1 


+ 
_® 


m NE 
E 2+2+ 2 + 2 +2+ 
A LES. в 99 
0 12 р э P 


1 15 14 1:417 14138 141429. 


The difference between neighbouring convergents is 


Pa Рыа _ (раі ida dn " " 
Оһ Qn-1 (=D Oye (п = 1, 2, 3, ...). (5.3) 


The difference between convergents whose indices differ by 2 is: 


Pasi Ра eee 

1 пі ш (LPH eee (8—1,2,3,..). (5.4 

Qum о 1 ах 
Continued fractions whose partial quotients have positive terms. 

It follows from equations (5.4) that, if all the terms of the partial 

quotients are positive, the convergents of even order form a mono- 

tonically increasing sequence, bounded from above by the number 


by+a,/b,. Such a sequence has a limit. Consequently, lim P,,/Qon 
n со 


exists in this case. Similarly, if all the terms of the partial quotients 
are positive, the convergents of odd order form a monotonically 
decreasing sequence, bounded from below by the number bọ. Such a 
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sequence also has a limit. Thus lim Pj, ,/Q,,. , also exists. Thus 


т оо 


the value (if it exists) of a continued fraction, of which all the terms 
of the partial quotients are positive, is always greater than any con- 
vergent of even order and less than any convergent of odd order. 


The number lim P,/Q,, is taken to be the value of a continued frac- 
п> со 


tion (5.1). 


2. Transformations of continued fractions 


The fundamental identity transformation is 


а а аһ 


ЛЕЛИ т ш 


by + 
ра, Pp Ра-1Рпаа (5.5) 
рб + рь +... + ри +... 

where р, p», ... are any numbers, finite and non-zero. 

Ordinary continued fractions. By using transformation (5.5), we 
can always reduce a continued fraction (5.1) to the form 


la E I 


kites == , (5.6) 
а tat... TF XR eee 
where 
m.s _ 224; sog obo i BE TREE RU 
0005) Mon Se AOR A 
dida. . . ok 1 ааа... Azk 


We сай (5.6) an ordinary continued fraction, while the numbers о, 
čp.. are the partial denominators of the ordinary continued 
fraction. ` 

An ordinary continued fraction with positive integral partial 
denominators is said to be regular. Only regular continued fractions 
are usually considered in the theory of numbers. 

Continued fractions, of which all the partial denominators are equal 
to 1. Such fractions are obtained from the fraction (5.1) by a trans- 
formation (5.5) in which we put p, = 1/b,(n = 1, 2, ...). When 
bo = 0, such a fraction has the form 

i G Cn 


те (5:0 
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where 


The terms of the partial quotients of fractions (5.6) and (5.7) are 
connected by the relationships 
с = А Cn = : 
oy On 1n 
Daniel Bernoulli’s continued fraction. The continued fraction, the 
convergents of which are equal to Ko, Кү, Kz,..., has the form 


K-K К-К. (Ki Ко) (K-K) 


(п = 2, 3, ...). 


акк К-К, +... 
(Kn-2— Каз) (Ка-1— л) 
Ха аа. (sg 
„+ ЕЕК poa G8 


EXAMPLE 2. The continued fraction for which K, = 1/n+1)° 
(п = 0,1, ...), has the form 


3 15 33 59 Qn – 3) Qn 4-1) 
41-42—43—44— ...— án EHE 
1 1 3 15 

1.4 37 24007 


K=1- 


3. Contraction and extension of continued fractions 


If we take as Ky, Ку, Ks, ... some subsequence of convergents of 
fraction (5.1), we say that the fraction (5.8) has been obtained by 
means of a contraction of fraction (5.1). Whereas, if we take as Ko, Ку, 
К„,... а sequence which includes in particular all the convergents 
of (5.1), we say that the fraction (5.8) has been obtained by means 
of an extension of fraction (5.1). 

After putting К, = P,,/Q,,, we have 


а а аһ a,b. 
ne RIS dU а лла 
azab, ааб, 
— (baba + аз) + bza, — (babs наз) Date — . … - 
йул -205п -1Воп-4бољ . (59) 


‚+ — (Pan -2бзп-1 + апт Pon Lado — - . . 
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EXAMPLE 3 
1 i 2 1 1 1 
an лы жыр сыры мы 
17 а 29 
7 5 29 169 


On putting К, = P4,,,/Q,,,,, we have 


+a @ ъъ ааа 
oT bi tbat... bby dae: a - 
@азьз asa, b bg 


~ (biba + аз) + Ба; — (bab4 +а)ь + Бау... 


йул —1йәлбәл.—зЎәп+1 . 

+++ (Don iban + aza)ban+1 + Don anm i — +++ 
Here, the sign 5 indicates that the convergent of zero order of 
the continued fraction on the right-hand side of the last equation is 


the fraction 1/0, and not 0/1, since this continued fraction has for 
its convergents the convergents of odd order only of continued frac- 


tion (5.1). 
EXAMPLE 4. 
1 1 *5 1 1 1 
2 = — — = — — — 
RR ELA UM MEI PE UN D 
15 29 169 985 


0 2 12 70 408 


If we replace the sign = by the usual equality, we get the expan- 
Sion 


5 : 5 1 1 1 
теат с тыры 
5 30 175 1020 


The connection between ordinary and singular values of а continued 
fraction. If by = 0, the continued fraction (5.1) can be considered in 
two ways, depending on whether we take its zero order convergent 
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as equal to 0/1 or 1/0. In the first case the values of the continued 
fraction are described as ordinary, and in the second as singular. 
On writing K and К respectively for the ordinary and singular value 
of the same continued fraction, we have 


pui cie Rta & 
С++..." С++ 
0 a а la ава 
1 b, bbita 0B ҺЫ 


0 a abt 
1 b bib, 


It follows that the connection between K and K is given by 


yc 
К+ -a 


4. The transformation of a continued fraction resulting from а 
theorem of Stolz 


The following is well known in mathematical analysis: 
STOLZ’S THEOREM. Let 
Lim Pa = œ, Lim Qa = = Qui > Qn 
no n— оо 
Jor ail n. Then 
P. Рау Р, 
lim in = lim n+1 n : 
no Qn т =» оо Ол+1— Оһ 
if the limit on the right-hand side of the last equation exists, 
By using this theorem and the basic recurrence relations (5.2), 
we can transform the fraction (5.1) into a continued fraction, whose 
nth order convergent is (P,—P,_,)/(Q,—Q,_,), where P, and 
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P, ., are respectively the numerators of the mth and (n—1)th order 
convergents of the continued fraction (5.1), while О, and О„_, are 
the denominators of these convergents. This continued fraction 


has the form 


а аһ а а, +b,— 1 
a ou sb pos Gees 
Wb ыыы P UNE du + 
a3+b,—1 a,b, —1 
a T by— 1 d йз NUES) Mind 
аз T b4—1 m а, 1 5,—1 
+ bg PEST Pinet ba рее 
ЕХАМРІЕ 5 
1 1 1 1 
МЗ = 14554747 4 Е 
125712 
] d 3.4 1 
и б о _ ы 
(0070414143 +1+3+... 
de orm M 324 
1 0 2 2 1 


A more general transformation of continued fraction following from 
Stolz's theorem. We apply Stolz's theorem to the sequence 


YnPn E 
Е (rm d xs 


where P,/Q, (n = 0, 1, 2, .. .) are the convergents of (5.1), and уо 
Vis у»... ате any non-zero numbers. Now, if the inequality y,Q,, > 
Yn-12n—1 is satisfied for all n, we have, by Stolz's Theorem: 


lim Pa lim УлЁһ—Ул-1Ра-1\ 


п Од пә YnOn — Yn-1Qn-i 


if the limit on the right-hand side exists. 
By using this equation and the basic recurrence relations (5.2), 
we can transform (5.1) into a continued fraction, whose mth order 
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convergent is (y,P, — y, ,P4 /0,Q,—7v, 10,4... This continued 
fraction has the form 


а; а, а, 
Kb et In. 
wb tbs peus ds doge 


1 
UI. d | by — 
ла у (улуг) + YoYab2 — YoY) 


= bo + 
yb ys + 3-1 + 
У 
УзУзаз + УуУзЁз — Vie a 
YiYada + оба — Yo71 
Yaba -Ya , Yo, УгУзаз РУз — У +... 
Ya Y2 YiYado + YoYaPa — То 
Уп-1Ўп@п + Yn—2¥nPn — Ya ini 
Yn-2Yn-idn-1-- Уп—зУп-1Ёп—17 Yn-aYn-a 
УпЁл — Yn-1 + Yn-3 Ya-1Ynün + Yn—2¥nln — Yn-2Yn-1i 
Yn-1 Yn-i Ya-z/n-idn-i-Yn-3Yn-iÜn-i— Yn-aYn-à 
уже 


+ 


an-ı 


et 


EXAMPLE 6. 


11 95 319 © (я#—3п-+„1)(+п—1) , 
+12+ 26 +44+...+ 2(п° — 3) Te. 


235 7535 
т 1 165 5335 

This gives us an expansion of V2 as a non-periodic continued 
fraction. In number theory there is a theorem which asserts that every 
irrational square root can be expanded as a periodic continued 
fraction and that, conversely, the value of every convergent periodic 
continued fraction is some irrational square root. But it is not always 
pointed out that an irrational square root can also be expanded asa 
non-periodic continued fraction, there being an infinity of such ex- 


pansions. The expansion. of 2 obtained by us as a periodic con- 
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tinued fraction is more slowly convergent than the initial expansion 
of 42. 

Corollaries of Stolz's theorem and transformations of continued 
fractions following from them. Let the sequence (P,/Q,) satisfy the 
conditions of Stolz's theorem. The sequence {Р2/02} now also 
satisfies the conditions of the theorem. Therefore ` 


zc P 20 PatPre 
lim = lim 2*—77-1, 
п->= Оп п ~ Оп + Qui 


We can obtain, on the basis of this equation, the following trans- 
formation of a continued fraction: 


a а, а, 
a аһ shan 
И ЭЛ Та 

Ба +1 bn— an+! 
%—а;+1 bom tie? Ба алі? . 
— +1 + b,—a3+1 , b, — asl 
b3+1 а и ERE рана 
EXAMPLE 7 
1 1 1. ! 

кашк TES uL 


Man LE ESL: 
2-3+3+4+3+1+... 

The following equation may also readily be obtained from Stolz’s 
theorem: 


lim Pa = lim УһР, + Уп-һРп-һ 


n- Оп п PnQnt¥n—nQn—n 


where {y,} is а sequence, the terms of which are all non-zero. We 
can obtain on the basis of this equation as many different identity 
transformations of a continued fraction as desired. 
A further transformation of continued fractions. Let us consider the 
identity 
a % b су G 


Bod & =b à a 5.10 
ЪЪ, ++ РЕ eum 
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Let us suppose that the convergents of even order of the fractions 
appearing in this identity are equal if their indices are the same. 
Now, on performing a contraction of the continued fractions and 
using the basic identity transformation to make corresponding terms 
of partial quotients of the contracted fractions equal, we obtain the 
following two systems of equations, connecting the terms of the 
partial quotients of the initial continued fractions: 


— bcd; = abo, 


5.11 
Сасай, == аад, сп) 


апа бол—2бәпл-1%п = Gon aem iP aD П=2,3,.... 


Cyd, + did; + Cz = bib, +a, 
(dan aan —1 + Can -1) dan + пзп = (5.12) 
(п = 2, 3, ...). 


= (Din -2Рап-1 + @п-1)®эл + Pon 20 


Systems (5.11) and (5.12), taken together, contain 2л equations 
with 4n unknowns c, and а, (п = 1, 2, ...). It is thus impossible, 
in the general case of equations (5.11) and (5.12), to express с, and 
d,(n = 1, 2, ...) in terms of a, a,..., 5), ba... or, conversely, 
а» b, (n = 1,2, ...) in terms of са, @,..., d d, .... But if bo = 
=l CQ = —а,, don, = ba dii = Ард (п = 1,2,... А # 1), 
the identity (5.10) takes the form 


а а а 
142 2 M = 
Bae ea e NNUS ee Е 
Ё азм ъъ ____ ab, а 
© 1 -а + byby +24 1 — Ь.б, 2а, За – 1 —... 
Aniban aonban-2 
m. Dan aden iden + 2431 -10зп +2aanban-z — l =... 
(5.13) 
EXAMPLE 8. 
i 1 1211 1 1 1 
2=1+= = —-— $5 TOYS TOY 
42b 54 [Dene Nes Gs eee ea qe 
01 8 7 48 41 280 239 
Tl 6 5 34 29 198 169 
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If the equations 


are satisfied, then equation (5.10) takes the form 


a a а, 
ta ЕЁ m = 
TE db dE таи 


Та a а тъ Azn (5.15) 
1 —'b, + by + ba +... + bon ++... у 


5. The properties of regular continued fractions 


A continued fraction in which all the partial numerators are equal 
to unity, and all the partial denominators are positive integers, is 
described as regular, or arithmetical. It follows from equation (5.3) 
that all the convergents of a regular continued fraction are non- 
reducible. 

Euclid’s algorithm and the expansion of rational numbers as regular 
continued fractions. Let u and v be two given positive integers, where 
и > у, On dividing и by v, we have 


й _ +12 
у = 40 y" 


where qo is the quotient and u, the remainder. On dividing v by 14, 
we have similarly 
E ш 


uw am. 


Proceeding in this manner, we get 


1 из 

„еи 
and so on. This process of successive divisions is known as Euclid’s 
algorithm. Since и, иу, uz, ... is a monotonically decreasing sequence 
of positive integers, the process is finite, 1.е. there exists an index п 
such that u,_,/u, = 9, (consequently, и, z 0, u,,, = 0). Hence 
и is the greatest common divisor of the numbers и and v. It is often 
denoted by (и, v). 
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EXAMPLE 9. Find the greatest common divisor of the numbers 
816 and 323. 
The computation is usually set out thus: 


8161323 
7646 2 
323 |170 
101 
1701153 
15317 1 
09 


(816, 323) = 17. Thus the expansion of 816/323 as a regular continued 
fraction has the form 


86 „1 lol 
323 1-149 
23 5 4 
1 1 2 19° 


Thus Euclid’s algorithm enables us not only to find the greatest com- 
mon divisor of two positive integers, but also to expand their ratio 
as a regular continued fraction. 

The solution in integers of an indeterminate equation of the first 
degree with the aid of Euclid's algorithm. The equation ax+by = c, 
where a, b and с are known, while x and у are unknown, is known 
as an indeterminate equation of the first degree. Such an equation 
has an infinite set of solutions. But it is often required to find only 
the integers that satisfy the equation, ie. in conventional language, 
it is required to solve the equation in integers. We consider here only 
equations for which а, b, c are integers. The equation ax+by = c 
has an integral solution only in the case when c is divisible by (a, 5). 
We can thus always assume that a and b are mutually prime. In this 
case the general solution in integers of the equation has the form 


x = (—1)""'cQ,_1+ (On, 
y = (—IPcP4-,— Pa 


where # is an arbitrary integer, P, , and Q, , are the numerator 
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and denominator of the penultimate convergent in the expansion 
of a/b = P,/Q,, as a regular continued fraction. 
EXAMPLE 10. 43x+37y = 21. 


Lr NE eee 
wer 37 6+6 
6|1 6 17 4 
0 6 T 6 3 


x = —21.6437t = 37{— 126, 
y = 21.7— 43t = 147—431, 


x = 3—15, y= 18—430, 


where again, ¢ is any integer. 

The convergents of a regular continued fraction as best approxima- 
tions. Suppose we have expanded any real number А as a regular 
continued fraction. Let us write P,/Q, for the nth order convergent 
of this continued fraction. The following inequality now holds: 


1 


Р, 
A -z б 
0.0.1 


Qn 


= 


These convergents are best approximations to the number 4 іп 
the sense that no rational fraction with denominator not exceeding 
О, can differ from A by less than the fraction P,/Q,,. 

The expansion of an irrational number as a non-terminating regular 
continued fraction. Every real irrational number can be written uniquely 
as a non-terminating regular continued fraction. Conversely, every 
non-terminating regular continued fraction (such a fraction is necessar- 
ily convergent, by Seidel’s convergence test, see § 2, sec. 2) is the 
expansion of one and only one real irrational number. 

Periodic regular continued fractions. The regular continued fraction 

р 
do a debes 
qə} ... Of its partial denominators consists of a repetition, with 
the same period, of the n numbers go, 4, ... ds 

If the repetition starts with some q,(k = 1) instead of with go, the 
regular continued fraction is described as mixed periodic. 


is said to be purely periodic if the sequence go, qis 
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Similar concepts of periodic continued fractions may also be intro- 
duced for continued fractions of a general type, although regular 
periodic continued fractions are primarily discussed in number 
theory. 

The expansion of irrational square roots as periodic continued 
fractions. Every periodic continued fraction (not necessarily regular) 
represents an irrational square root. An important role is played 
in number theory by a theorem of Lagrange, which states that 
every irrational square root can be expanded as a periodic regular 
continued fraction. 

For example, 


monk Жей Болт. duod 
С 1+1 +1+1+6+1+1+1+6 +... 


Notice that the expansion of 4/13 as a continued fraction of general 
type, 
2 1 1. 1 


4 
JB -3:/13-3)934:—À—— д д . 
x ) КУ ЛЗ 3+3+3+3 +... 


is obtained more simply and is more rapidly convergent. Thus ће 
expansion of irrational square roots as regular continued fractions 
is more of theoretical rather than practical interest. 


6. Equivalent and corresponding continued fractions 


When transforming the power series Aj+A\x+A,x?+... 
into a continued fraction, two cases can be encountered: (1) the 
convergents of the continued fraction coincide with the partial sums 
of the initia] power series; (2) the convergents do not coincide with 
the partial sums of the initial power series. In the first case the con- 
tinued fraction is described as equivalent to the initial series, and in 
the second case as corresponding to the initial series. The expansion of 
the nth convergent of the corresponding continued fraction as a power 
series coincides with the initial power series up to and including the 
term in x^. It is clear that an equivalent continued fraction is only 
another form of writing a power series and does not yield new appro- 
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ximate expressions for its sum..As regards convergence, a power or 
numerical series and the continued fraction corresponding to it can 
behave differently. They may be both convergent, or both divergent, 
or one be convergent and the other divergent. The domains of conver- 
gence of a power series and the continued fraction corresponding 
to it may thus be different. For instance, there are power series with 
radius of convergence equal to zero, which can be transformed into 
corresponding continued fractions that are convergent in a fairly 
wide domain. 

Equivalent continued fractions can sometimes be readily transform- 
ed into corresponding ones by means of the transformation (5.13). 
Since it is far easier to construct the equivalent rather than the 
corresponding fraction, the application of transforming equivalent 
fractions into corresponding ones is of practical interest. 

The construction of equivalent fractions. For this purpose it is 
easiest to employ Ewler's identity: 


Ў eax" = + ая сх сх Cy—2CnX . 
n=0 — ХС CX 0... — Cni OX Ls. 
(5.16) 
This identity can also be given the form 
x ex = бо ex CoCoX С1С3Х 
no l — офах- а+ех-е+ех-... 
Cn—2CnX 
Peat to А 5.1 
2 Cpu ten X — ... б.17) 
EXAMPLE 11. 
ТРЕЕ ож E.g = 
= 
TE x 9x? Qn – 1х2 А 
~ 1-3-2 + 5-33 +... +2л+1—(2л0—1)х9®-+... 


In particular, when х = 1 we have, 
л ] 1 3.5 7 (2n—1)? 


оо ро 2 ae 
012 13 16 789 
TT 3 15 105 985 
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The last expansion was first obtained by Brouncker (1620—1684). 
This relationship is regarded as historically the first expansion of 
a transcendental number as a continued fraction. 

On applying transformation (5.13) to the expansion of arc tan x 
аз an equivalent continued fraction, we get the continued fraction 


arc tan x = x— Эх зд" 2 
= 15+9%  — 1 ыыы 
x 1Sx+4x243x5 15х—5х%-Е3х° 
1 1549x* 15 


which is no longer equivalent. In particular, when x = 1 we have 


2 9 25 49 81 (4n— 1)? 
24— 1 — 152- 1 —408—...— 1 — 


1 22 13 106 789 
1 24 15 1680 945 


л 
qc 


(4n + 1)? 
— 8(®-+ёл+3)—...' 


7. The formation of corresponding fractions. Viskovatov's method 


The terms of the partial quotients of the corresponding continued 
fraction can be expressed in terms of the coefficients of the terms of 
the initial power series, although high order determinations appear in 
the relationships thus obtained. This makes such relationships of 
little practical use in the majority of cases. It is therefore better in 
practice to use a method of successively obtaining the terms of the 
partial quotients of the corresponding continued fraction from the 
terms of the power series. Such a method was proposed in principle 
at the beginning of the nineteenth century by the Russian scholar 
V. Viskovatov. Viskovatov's method amounts to the identity, 


Кә = оло их HUX? Низ +... — о ох XX 
Xoo +0015 00902 3+... Xoo о + yg +...’ 


where 


тт = %m—1, o%m—2, n«17 %m—2, 0% m—1, n1 
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Computation of the coefficients с, may be conveniently set out 
in accordance with the scheme: 

Xoo Фо “02... 

Qio бл ee 


&o9 ба ба... 


EXAMPLE 12. Let us expand the expression (1—х)/(1- 5х-+ 6х?) 
(x < 1/3) as a continued fraction. We have 


1 —5 6 
1 -1 
-4 6 
-2 
— 12. 
Consequently, 
1-х m 4x 2x 12х — 
1—5х+6# 1- 1 — —-4- 2 
xd E eu = 
1- 1 4 2 - 1 
1 1 2-х 2—2x 
1 


1—4х 2—7x 2—10x+12x? 


If, when computing the coefficients сти, it turns out that «,, = 0, 
then the (k+2)th row of the scheme is obtained by means of a shift 
of the (k+ ГВ row one place to the left; the (k+3)th row is obtained 
by combining the (k--2)th and the kth rows in accordance with 
the general rule, the (k--4)th row by combining the (k--3)th and 
(k+2)th, and so on. The expansion in this case has the form 


Дх = Xio Ф202 Язох 
оо + Xio + X20 +... 
RT р 
pig oX Qh, 1X? барах Chae, 1X 
а а Аан wee, Я 
+++ + Op 2,0 Тао т + Akti t ee 
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EXAMPLE 13. Let us expand the expression (1— 3x3)/(1— x?— 4x‘) 
(x? = (VIT. —1)/8) as a continued fraction, we have 


1-39 1 х0 3х 5х 25x 30x 15x _ 
I-xi-4x*  1-1--1--3+-5+ 25 – 1 — 
zio, Žž k 5х 
Е 1 - 3 + 
01 1 1+3х 3+34х 
11 1-0 1435-22 3+4х—3х% +59 
5x 12x 3x 
+ T Е 5 - 1 
349x + 152 154-9x +4 27x? 15 — 45x 
3+9х+ 122 15+49x+12x2 +363 —60х4  15— 15x3 — 60x! ` 
1 0 =! 0 —4 
1 0 0 -3 
0 —1 3 —4 
-1 3 —4 
-3 4 3 
-5 15 
25 —15 
300 
— 300.15. 


8. Appell’s method 


In 1913 Appell proposed the following method enabling any 
positive number to be expanded as a continued fraction. 

Let N be any positive number. Let a be the square root of N, comput- 
ed with a deficiency of not more than 1. Thus N = a?-- R, where 
0 = А = 2a+ 1. Weshallassume a = Oif N< 1. We put R = (2a + 1)/N;, 
where №, > 1. Let a, be the square root of №, computed with 
deficiency of not more than 1. Then № = a?+R,, where 0 < R, = 
~<2a,+1. We put В, = (2a,+1)/N, and continued this process inde- 
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finitely. Generally speaking, N is now expanded as a non-termin- 
ating continued fraction. 

ИМ, = М, Nis expanded a pure periodic continued fraction. If 
№, = №, (1 = т-р), Nis expanded as a mixed periodic continued 


fraction. É 
EXAMPLE 14. 
5 5 5 
= May ae 224 = = VN cdd 
== +5, MN 5= 2+5 ox. - 
EXAMPLE 15. 
3 3 3 
= 124.2 = о о ү 
2=1+5, 3=1 Ер Вс, 
2 
5 5 3 
mq. o ee = 
fao у= +55 MN 
2 
з 3 3 5 3 3 
ER EBD MC E Un 
2= + зуулар Л, 
second period 
EXAMPLE 16. 
14 J13 42, 3 а 
2 12+ 12+ 12 


Appell also pointed out the more general relationship 


м аа-а (nta 


a + a +...” 

Here а,, ap... are positive integers, while a may also be equal to 
zero. Here we can take the nth root of the number with a deficiency 
or with an excess of not more than 1, or we can even alternate in 
various ways the approximation of the root with a deficiency and 
an excess in the expansion obtained. 
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§ 2. Fundamental tests for the convergence of continued 
fractions 


1. The convergence of continued fractions 


It was mentioned above that a continued fraction for which lim 
п co 
P,,/Q,, exists and is finite is described as convergent. The value of the 


continued fraction is in this case taken equal to this limit. But it does 


not follow from the convergence of a continued fraction that lim 
N > оо 


P,/@, is equal to the magnitude which has been expanded as the 
continued fraction. 

Essentially and non-essentially divergent continued fractions. If 
lim P,/Q, = + œ or Ша P,/Q, = — œ, the continued fraction is 


п => со n oo 


said to Бе non-essentially divergent, whereas if lim P,/Q, does not 


п> оо 
exist, the continued fraction is said to be essentially divergent. The 
concepts of essential and non-essential divergence were introduced 
by Perron. 
Unconditionally and conditionally convergent continued fractions. 
Unconditionally and conditionally convergent continued fractions. 
It is well known that the convergence of a series or infinite product 
is not affected by the removal of a finite set of terms. In continued 
fractions, however, the removal of a finite set of partial quotients 
(excluding the zero partial quotient) can turn a convergent fraction 
into a non-essentially divergent fraction. Pringsheim therefore intro- 
duced the following concepts: a continued fraction la,/b,]r is 
said to be unconditionally convergent if, for all m z 1, the fraction 
[a,/b,]5 is convergent. Whereas if the latter fraction is divergent 
for at least one value of m, the fraction [a,/b,]? is said to be 
conditionally convergent. It follows from this that it is not in general 
possible to quote convergence tests for continued fractions in the 
limiting form as used for series. The convergence conditions, connect- 
ing, say a, and b,, must be satisfied for all positive integral п. It 
‘must be emphasized that the removal of a finite set of partial quotients 
can turn a convergent continued fraction only into a convergent or 
a non-essentially divergent fraction. 
А necessary test for the convergence of a continued fraction [1[х,]. 
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KocH's THEOREM. The convergence of the series » læn! 
sufficient for the limits lim P,, = Р, m ML "LIA ‚ма On = = 0, 
lim Q4,,, = Q’ to be finite, and the relationship P’ Q- во”, = 1 to be 
satisfied. It follows from this that the divergence of the series У [а | 
is necessary for the convergence of the fraction [1/х„}°. i 


Uniform convergence of a continued fraction. If the terms of the 
partial quotients of a continued fraction are functions of a finite 
or infinite set of variables, the continued fraction is said to be uni- 
formly convergent on the set E of variation of these variables when 
its convergents P,/Q,, tend uniformly to a limit in Е, i.e. when, given 
any e > 0, we can find a number N such that, for n = М, Q, isnon-zero 
on the whole set E and the following inequality holds: 


Р 
lim = 


a cim 
Qn А оо о, 
It follows from this definition that the series (see [3D: 


Py < P, un Py B a1 P102 - - - 3 
mak бы чак mL —])j4-1 = 4 * 
( On ‚л ) 03-10, 


(5.19) 


<e. (5.18) 


is now uniformly convergent in E to lim P,/Q,, since Р„/О„ is its 
т> оо 
partial sum, while lim P,/Q,, is its sum. Conversely, condition (5.18) 
n ее 
follows from the uniform convergence of this series, i.e. фе uniform 


convergence of the continued fraction. Jt also follows from this 
definition that the values of the continued fraction and of the series 
(5.19) coincide for any x € E, i.e. that the continued fraction and the 
series (5.19) are identically equal on the set Е. 

A condition for the convergence of a continued fraction to the function 
which can be expanded as this continued fraction. The uniform converg- 
ence of the continued fraction 

сү сх сих 


TASA очи... ES n-L2..) 620) 
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on the set E is a sufficient condition for this fraction to be convergent 
on the set E to the function K(x), which can be expanded as the con- 
tinued fraction. 

It follows from this theorem that, if the fraction (5.20) is uniformly 
convergent for | х | < o, itis convergent for | х| = о to a regular single- 
valued analytic function, which can be expanded as the fraction 
and which can be expanded as the power series corresponding to the 
fraction (5.20), this series being convergent to the same function 
for |х| <о. The condition is therefore obtained in order that the 
continued fraction and the power series which correspond to each 
other are convergent to the same function. Notice that the domain 
|x| < о can be replaced by any domain T'containingzero as an interior 
point. 

If zero is a boundary point of the set E, then o = 0, i.e. the power 
series corresponding to the fraction (5.20) is divergent everywhere 
except at zero. But the fraction (5.20), uniformly convergent on the set 
E, is nevertheless convergent on this set to the function that we have 
expanded as this continued fraction. This function can be expanded 
in the present case in a neighbourhood of zero as a divergent power 
series, ie. it is not analytic. The convergents of the fraction (5.20) 
are thus approximate expressions for a non-analytic function, i.e. 
we have to some degree solved the problem of the approximate 
evaluation of non-analytic functions, 

The condition for identical equality of two uniformly convergent 
continued fractions. If the values of two continued fractions, uniformly 
convergent inside a domain Т containing zero as an interior point, 
are coincident in a domain S which is contained wholly in 7, then 
these fractions are identically equal inside the domain 7. 

Uniform convergence of the fraction [c,x/l]g,,. The uniform 
convergence of the fraction [c,x/1]5,, inside a domain T con- 
taining zero is sufficient for the uniform convergence inside Т of the 
fraction K(x) = [с1/1; e,x/1]7, after the possible exclusion of a 
finite number of points x' of non-essential divergence. The fraction 
[n/1; сх] is convergent here inside Т to a single-valued 
analytic function K(x), regular inside Т, except at points x', which are 
the poles of this function. 
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2. A necessary and sufficient test for the convergence of a 
continued fraction in which the partial quotients have 
positive terms (Seidel’s test) 


æ 
As has been shown, the divergence ofthe series У |а, | is necessary 


nel 
for the convergence of the fraction [1/x,]". Seidel, and independ- 
ently Stern, showed that if all the terms of the partial quotients of 
the fraction are positive, the divergence of the series is necessary and 
sufficient for convergence. 

EXAMPLE 17. The continued fraction 

TUNE MET 
2+2+2 +... 
is convergent by virtue of Siedel’s test, since the series 2+2+... 
is divergent. 

Notice that the convergence of a continued fraction in which the 
partial quotients have positive terms depends on the divergence of 
a certain series, i.e. the behaviour of the entire set of terms of the 
partial quotients, not on the behaviour of each of them. A convergent 
continued fraction in which the partial quotients have positive terms 
is therefore unconditionally convergent. 

On passing from a continued fraction of the form (5.6) to a con- 
tinued fraction of the general form (5.1), the following statement of 
Seidel’s test is obtained; this statement was proposed by Stern. 

The divergence of at least one of the series 


= dd... ар S M.-A у (5.21) 

ne Ча... М " 4105 - «09g 1 ENS 
is necessary and sufficient for the convergence of the continued fraction 
(5.1), of which all the terms of the partial quotients are positive. 


3. Tests sufficent for the convergence of continued fractions 
in which the partial quotients have positive terms 


Establishing the divergence of one of the series (5.21) is usually 
fairly difficult in practice. Thus it is often more convenient to make 
use of various tests which are sufficient for the convergence of conti- 
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nued fractions with partial quotients having exclusively positive terms, 
Some of these tests are given below. 


1°. Divergence of the series У (b, ,b,)Ja, is sufficient for the 
‚п=2 
convergence of the fraction (5.1) when the partial quotients have positive 
terms (Stolz). 
2°. Divergence of the series у, УБ, ) Ја, is sufficient for 
п=2 


the convergence of the fraction (5.1) when the partial quotients have 
positive terms (Saalschiitz and Pringsheim). 
3°. Divergence of the series 
| о 
n=2 an 
1+ 
b. ibn 


is sufficient for the convergence of the fraction (5.1) when the partial 
quotients have positive terms ( Arndt). 
Notice that, if 


then 


Hence all the tests for convergence of continued fractions in which 
the partial quotients have exclusively positive terms may readily 
be extended to continued fractions in which all the partial numerators 
are positive and all the partial denominators negative. 


4. First set of tests sufficient for convergence 


Let the numbers г, г, ... satisfy the following conditions (Scott 
and Wall), 


и Иез] = lel, 

2) re |1 +62 + с3| = les, 

3) Ta | 1+ Сл tenga] = Гога! Сп | + | Спа! (п = 3), 
4) г. = 0 (п = 3), 


(5.22) 
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where со, сз»... are the partial numerators of the fraction 


_1 6 € Cn 
SEIT Eod be (5.23) 


If the series у, Рә..." is convergent, then the fraction (5.23) 
n=1 
is convergent, while 


[Kl st Улт... (5.24) 
n=1 


If the numbers гу, r2,... satisfy conditions (5.22) and at least one 
of the c, is zero, the fraction (5.23) is convergent. 

If c, сз,... are functions of several variables, the above converg- 
ence test takes the following form. Jf the numbers r,, r4, .. . satisfy 


conditions (5.22), and the series У r,r, ...r, is convergent on a set E, 
n=1 
the fraction (5.23) is uniformly convergent on E, inequality (5.24) 
being satisfied. 
In particular, the set Е can be chosen on the basis of the following 
theorem due to Scott and Wall: 


The set of conditions 


Pn- 1 


>1, |211 = 
Pi al Рп-1 Рп 


(п = 2, 3,...) (5.25) 


where ру, ро are the terms of some numerical sequence, is sufficient 
for uniform convergence of the fraction (5.23) and for the following 
inequality to be satisfied: 


Ils АТ ———— шышы], „4806 
А 1+ $i DGs- D... (7 D 


Inequality (5.26) becomes equality if c, = (1—p,)/p,. p, (1 = 2, 
З); 
If p, = 1, Scott апа Wall's theorem takes the following form. 
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The following conditions: 


(0) р = 1; 
Рь— 1 . 
= 12, By) 34 
(2) [ел | EVE. (n ) 
(3) the series > (2—1) (3-10... (Рь„—1) is convergent; 


nal 
are sufficient for the uniform convergence of the fraction (5.23) and 


for fulfillment of the inequality 
|K] S1+ 2 P- 1)(5—1)...(Ра+1— 1). 
n= 


This becomes equality if c, = (1—p,)/p,.P, (n = 2, 3, ...). 
In particular, of p, = (2n+1)/+k), the following theorem is 
obtained, by virtue of (5.25) and (5.26). 
The condition 
т№ -—(k—1y E 
AMI. (n =2 Эа .) (5.27) 
is sufficient for the uniform convergence of the fraction (5.20), while 
we have: when k = 2, 


[cn] = 


3 1 
IX] 357% Ty 52203-5 ups E 
А lak DEK" п+Ё 


An investigation of the series in the denominator on the right-hand 
side of the last inequality shows that the series is convergent for k > 1 
and divergent for К = 1. In addition, it follows from inequality (5.27) 
that —1 < < 3. Hence, when —1 < k = 1 (5.28) takes the form 


к= 527 _ 629 


and only retains the form (5.28) for 1 < < 3. 
Vorpitskii’s test. When k=1/2, we have p,=2. In this case 
(5.27) takes the form 


1 


T (022,3, ...), (5.30) 


les 
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while | K| = 2 in accordance with (5.29). But we can replace (5.29) 
by the stricter inequality: 


go (5.31) 


4 
3 


VAN VLECK’S THEOREM. The condition 
OB 88 (п = 2, 3,...) (5.32) 


is sufficient for the fraction К = [1/1, e,z/1]y to be convergent in 
the circle |z | < 1/4g to a regular analytic non-rational function, which is 
also equal to the series corresponding to this fraction, while | K— 
— 4/3] = 2/3. 

The proof of this theorem follows from Vorpitskii’s test. 


5. Tests for the convergence of continued fractions periodic 
in the limit 
The fraction [a,/b,]*, for which a, z 0, lim a, = a, lim b, = b, 


»— оо о —> оо 


is described as periodic in the limit. Such fractions are of great practical 
importance, since they are connected with the expansions as continued 
fractions of a large number of commonly encountered functions. 
The convergence tests for continued fractions periodic in the limit 
follow from the theorem: 
The condition lim sup {|c,|} = g is sufficient for the fraction 


ро 
€. С? |" 
E : 7] (5.33) 


2 


to be convergent in the circle |z| < 1/48 (excluding possible poles) to a 
regular analytic non-rational function, the poles of the latter being 
the points of non-essential divergence of the fraction. In a neighbourhood 
of zero this function is equal to the series corresponding to the continued 
fraction (5.33). 

Having chosen as the g in this theorem any positive number, as 
small as desired, we pass to the following theorem. 

The condition lim с = 0 is sufficient for the fraction (5.33) to be 


ро 
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uniformly convergent in any finite domain of the complex plane, excluding 
a finite set of points of non-essential divergence, to an analytic function, 
which is regular in a neighbourhood of zero, and is regular in the re- 
mainder of the domain except for the above-mentoined points of non- 
essential divergence of the fraction, these being the poles of the func- 
tion. The point z = œ is essentially a singular point of the function. 


To generalize this theorem, we assume that lim c, = с # 0. We 
у —> оо 
thus arrive at the following theorem. 


The condition lim c, = c = 0 is sufficient for the uniform converg- 


-> %0 


v 
ence of the fraction (5.33), excluding a finite set of points of поп- 
essential divergence in any domain Тс T, where T is the complex 
plane with a cut along the real axis from the point (—1/4c, 0) to an 
infinitely remote point, such that the cut does not pass through zero. 
If the cut starts from zero, the following Stieltjes test holds. 
Suppose the following conditions are satisfied: 


(1) оц, м... are real and non-negative; 
(2) ел, €, . ола»... are not all zero; 


(3) the series Y, а, is divergent. 


kel 
Then the fraction (z/x,]"° is uniformly convergent in any finite 
domain lying inside the complex plane, cut along the negative part of 
the real axis. 


$ 3. The expansion of certain functions as continued 
fractions 


1. Lagrange's method 


Lagrange proposed the following method of solving differential 
equations with the aid of continued fractions. Suppose we have a 
differential equation in y and x, and assume that y z &, when | x | ~ 0. 
We now put y = £/(1-- 4) and substitute this relationship into the 
original equation. We obtain a differential equation in у, and x. 
Suppose y, = $; when |x| = 0. We put y, = &/(1- у) and repeat 
the process. All in all, we arrive at the solution of the original 


270 MATHEMATICAL ANALYSIS 


equation in the form of the continued fraction [5,/1]7; £, is more 
conveniently sought in the form a,x"*, where rv, = 0. 

Many differential equations can be solved by this means, but it 
generally proves difficult to find the dependence of £, on the index 
n, i.e. to find the general partial quotient of the continued fraction. 


2. Fundamental differential equation 


Let us apply Lagrange's method to the equation 
(a rc x)xy' +B + B'3)y + Уу = bx, xO) = 0. (5.34) 


Having put y = дх(а+8+ уу), the equation is reduced to the 
form: 


(к o! x)xy +a +p- (6 +B )х]у, + = [0 B) (6 +P) +уйх. 
On repeating this process, we get the continued fraction 


ӧх [а В) +В) убх (ex аВ +a’ + yd)x 


у = 


a+ B+ 2a +В + За +В +... 
(их + Ви" + В’) -vólx — (аа — naf! по В + уб)х 
‚2+ 2nx +B + (2n -- )« - B +... 


It is readily seen from this that the differential equation 
(a +a'x®)xy'+(B+P'x®)y+yy? = 65, 0) = 0 (5.35) 
has the solution 
ee ôx? [ka + В) (ко + В") + у8]х® 
kx po 25а +B + 
(Кох! — ka! + ka] ~ уд)х® 
+ 3ka 4 В +... 
Кико +B) (nka' + B^) + уб]х® 
+ danke + B + 
("К хо" — пкаВ' + nke'B + уб)х® 


+ (2n + Ika +B rd (5:36) 


Almost all the differential equations, the solutions of which were 
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expanded as continued fractions by Lagrange, Euler and others, are 
particular cases of equation (5.35). It is therefore natural to refer to 
(5.35) as the fundamental differential equation. 


3. The expansion of a power function as a continued fraction 


Let us put y = (1+ x)”, where у is any real number. Then (1 + x)y' = 
=vy = уу, у(0) = 1. On putting y = 1+»x/(1+z), we reduce the 
differential equation to the form 


(1+x)xz'+[1-(—»)x}z +22 = (1-»)x, 2(0) = 0. 
This is a particular case of equation (5.35), in which 

К=а= а =В=у=1, В = —(1—»>», = 1-2. 
We thus have, from expansion (5.36): 


эх (1-»х (1+)x 

+ 2 + 3 + 
(2—»)x (n—»)x (n+v)x 
P1300 {къз Че» 0 риа 


(1 +x)" ed 


(5.37) 


This expansion was obtained by Lagrange. In view of the above- 
mentioned convergence tests, it is convergent on the complex plane 
cut along the real axis from x = — о to х = —1. 

The power series into which the function у = (1--x)" can be 
expanded is convergent in an open circle of radius 1 with centre at 
the origin. The expansion of the function у = (14- x)" as a continued 
fraction is therefore convergent in a much wider domain than the 
expansion of the same function as a power series. 

EXAMPLE 18. On putting x = 1, у = 1/3, we have 


5 3n—-1 Зп+1 
+2+...+ 2 4+32n+I)+... 
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On contracting the expansion (5.37) in accordance with formula 
(5.9), we get 


ты 2vx (1— 32) х2 
Е се 0r = 
(4— 9) (rà — а 
SOS co РО 


This expansion is convergent in the same domain as the expansion 
(5.37). 

Irrational square roots may be expanded as continued fractions 
by means of the following elementary method. 


Let үх = а. Then Vx = a4 (/x—a) = а+(х- а) а+ Ух). 
Consequently, 


кай х-а? x—a* 
DE Og ALT 2R уш. 


This expansion is convergent on the complex plane, except the nega- 
tive part of the real axis. 


4. The expansion of a logarithmic function as a continued fraction 
Expansion (5.37) can be put in the form 


(14 x*-1 


T 


(1—9x (+x Q-»x 
+ 2 + 3 + 2 
(24 ») (n—»)Xx (n+x 
PoS Я ae 201-45 


_ Х 
CU 


On setting > = 0, we obtain, since lim [(12- x)'— 1]/v = In(1+x): 
v {ео 
x x x 2x 2х nx nx 


Е GAUGE (5.38) 


This expansion and the method of obtaining it from expansion (5.37) 
were found by Lagrange. Expansion (5.38) is convergent on the 
complex plane cut along the real axis from x = — œ to x = —1. 
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EXAMPLE 19. On putting x = 1, we have: 


i22 1 i n n 
Е S vois) vi 
01 2 7 
TI 3 10 


5. The expansion of an exponential function as a continued fraction 
On replacing х by x/», expansion (5.37) takes the form 
1-» 1+9 | 2—» 


v x — X x 
(gy Елу Е IL L-R oll 
vj l+ 2 + 3 + 2 + 


+ 9 ч.2 + nl +... 
On letting v tend to œ, we obtain in the limit: 


x x x x x x 


x 
и 


(5.39) 
This expansion is convergent on the entire complex plane. The expan- 
sion and the method of obtaining it from expansion (5.37) were 
discovered by Lagrange. On contracting the continued fraction 
(5.39) in accordance with formula (5.9), we arrive at the expansion 
obtained by Euler: 


2x х? x x? 


= RIS WO AIDE аулы отти ы 


This expansion is also convergent оп the entire complex plane. 


6. Expansion of the function y=arc tan x as a continued fraction 


The differential equation for this function has the form 
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On setting у = x/(1 +z), this equation reduces to the form 
(1 4- xZ)xz' + (1-— х2)2- 2? = 22. 
This is a particular case of equation (5.35), in which 
e=e@sfPoy=6=1, P=-i, k=2. 
We therefore have, from expansion (5:36): 


x 4 952 ome 
$3454 74... 420410... 


x 


arc tan x = 
1+2 


= i (5.40) 
This expansion was discovered by Lambert (1728—1777). И is conver- 
gent on the whole complex plane except for two cuts along the imag- 
inary axis from — e» i to — i, and from i to +i, This expansion 
is thus convergent in a far wider domain than the power series into 
which the function y — arc tan x may be expanded (this latter series 
is convergent inside the unit circle with centre at the origin). 

The terms of the partial quotients of fraction (5.40) satisfy condi- 
tions (5.14). We can thus obtain a further expansion of arc tan x 
on the basis of equation (5.15): 
хз 9x? 4x? (21+ 1)2х2  Qnyx 


ры a a al 4n-l + 4п+3 e... 


x 
7. Expansion of the function y =| dt/(1-- t^) as а 
continued fraction о 


The differential equation for this function has the form 


+ 1 ыы: 
У = тргу y(0) = 0. 


Оп putting 


max. 
у= Tye 


the equation reduces to the form 


(1 4- xE)xz' +(1—x*)z 4 22 = xh. 
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This is the particular case of equation (5.35) when æ = & = В = у = 
= ô = 1, В = —1, К is any number. We therefore obtain, from 
expansion (5.36): 


1+ # +#+1+26+1+ 3k4+1 +... 


парах (nk + 1)?х* 
eod 2nk +14 QntDke+1 +... 


Q 


[ d х xk Kx КИА 
ТЕП, 
(5.41) 


This expansion was obtained by Lagrange. И is convergent on the 
plane of the complex variable x*, cut along the real axis from — oo 
to —1. When К = 1, expansion (5.41) becomes the expansion for 
In(14- x); when А = 2, it becomes the expansion for arc tan x. 


On substituting x?*! for x іп the integral | dt/(1+¢*) and setting 
0 
k(p4 1) =q, we obtain from (5.41) the expansion 
= тй o xt (р+1)ха gh 
144 © р+1+4+1+р+24+1+р+... 


?д?х1 (ng -„1-Ер)?хї 


Р ЕСЛИ о гатан ШШДЕ . (542 
eo +214 +l +р+ (21+ Па+1+р +... 0) 


For example, 


* rd 1 9 16 4 162 — (4ni3) 
01+ 347 +114 15 +...+ 81434 8247 +...” 
01 7 93 1738 
13 30 378 1 


On using conditions (5.14) and equation (5.15), we can write (5.24) 
in the form 


= pdt P+ prita (gg 1 кр) 
а “РЕТ grlap+ 2@+1+р_ 
9х4 (па +1 -+ pyxt nigiyi 
+ 39+1+р +... + 2nqgblep +(Qn+Dqtl+pr...’ 
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For example 


тей 0 1 49 16 (4n+3)? 16и? 
14455 3 7+11+ 15 +... + 8+3 +8л+7+...” 
1 4 95 1459 
3 51 378 6006 


8. Expansion of tan x and tanh x as continued fractions 


The differential equation for y — tan x is of the form 


у= 1+у, 20) = 0. 
On putting у = x/(1--z), this equation reduces to 
xz'4z4z = — х2. 
This is the particular case of (5.35) whena' = В’ = 0,2 = = у = 1, 
ó = —1, К = 2. We thus obtain from expansion (5.36): 


x x x xi 


Ba аа Eu 


(5.43) 


This expansion was discovered by Lambert. It is convergent on the 
whole plane of the complex variable x, except for the points at which 
tan x becomes infinite. 
On replacing x by x/i in expansion (5.43) and multiplying the 
resulting equation by i, we obtain 
x. (3 9? x 
йай ты зы On es pu 


9. Expansion of Prima's function as a continued fraction 
The integral 


| to-1 e-t dt (а> 0, x > 0) 
x 
is known as Prima’s function. Let us introduce the function 


у= »e| 10—1е- dt, 


x 
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which satisfies the differential equation 
xy’—(l-a+x)y = —х. 
On putting x = 1/7, у = 1/(1+u), this equation takes the form 
2и +[1-G—a)tlu = (l—a)t, u(0) = 0. 
This is the particular case of equation (5.35) when æ = 0, k = а = 


=fB=y=1, В = –(1-а), 8=1—а. We thus obtain from 
expansion (5.36): 


_@-а t 2-а) тш путай 
01 cl ОО... b+ 1 P 
On returning to the original notation, we get 


Е E 1—a ES 2-а 
» “x + +х+ 1+... 


u 


МО) 


On contracting this expansion on the basis of formula (5.9), we get 


an i-e dra xa2e-* 1-а 2(2— a) 
х+1-а—-х+3-а-х+5-а-... 


n(n— a) 
..- х+21+1-а-.... (5-46) 


= 
We call | (e'/t) dt the integral exponential function and denote it 


by Ei(x) (see (6.393)). We obtain from expansion (5.45) with a = 0 
and x <0: 
: 1 1 1 n n 
= efi .— Pak POM. А, б, 
mos (FS Te... THF © 


The function 


is called the integral logarithm and is denoted by li(x) (see (6.394)). 
We obtain from expansion (5.47): 


x o1 d 


ее 
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10. Expansion of the incomplete gamma function as a 
continued fraction 


To obtain an expansion of the incomplete gamma function, i.e. 
of the integral 


| иен (а > 0), 


0 


we introduce the function 


pe Г fedt (x20, 
0 


which satisfies the differential equation 
x'4(-3»-1-0, 00) = 2. 
On putting у = l/(a--y,) in this equation, we get 
ху t (a xn 4» = —ах. 


This is the particular case of equation (5.35) when k = а = В = у=1, 
а = 0, B = а, д = —a. We thus have from expansion (5.36) 


* хех ах x (1-+а)х 
а—1е— EN —— — L— 
I еса SITUE аа-аа 
2х пх (6+ п)х 
+4+а—...+2п+а—2п+1-+а+...` 


11. Thiele’s formula 
The Taylor series 
h 7 k ae he (n), 
fé 4-8) = Л) p oeH"ee... жет "о... 


corresponds in the theory of continued fractions to Thiele’s formula 


h h h 


Дх+® = + у л) + 3rref(x) +... 


h 
Фата) +... 
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Here r, f(x) is called the inverse derivative of the n-th order of the func- 
tion f(x). The inverse derivatives are defined by the relationships 


7%) = тр’ fe) = Да, 
and in general, for n = 2, 

ra f(x) = тах) + пет, s fix). 
For example, 

re* = e7*, пей = — е, ..., ге” = (— 1)", 
Гап +16 = (— D^ (n + De. 
Непсе 
(Qn 4 Dre = (— 1)” (28 + De7*, 

(2п + 2yr = 2(— 1e, 
If we use these relationships and replace x by 0 and A by x in 
Thiele's formula, we again arrive at expansion (5.39). 


Thus Thiele's formula is another source of obtaining the expansions 
of various functions as corresponding continued fractions. 


12. Fractional approximations for sin x and sinh x 


The general form of the expansion as a continued fraction of sin x 
is not known. Only a finite set of partial quotients of the expansion 
can be found by Viskovatov's method. For example, 


— s па seo 
1+ 6 — 10 + 98 — 198 +... 
х 6x 60x — 7x3 5880x — 620x3 
1 64% 60+3х° 5880. 360x3 + 11x! 
and 
РЕ. nme aw 
6 + 10 - 42 + 66 — ... 


х 6х—›2 G0x—T7x* 2520x— 360x3 + 1125 
Г 6 $6.3 2520 + 60x 
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It follows from the approximation 


60x — 7x? 


60 + 3x? о) 


sin x = 


that sinz/4 ~ 0.7071, if we put 2/4 ~ 0.7854. Hence, in view of 
the periodicity of the function y = sinx and the relationships 


add z К 
sin а = cosx and cosx = 4/1 — 510? x, the approximation 


(5.48) enables four-figure tables of this function to be evaluated with 
the aid of a calculating machine. In the same way, by using the higher- 
order convergents, we can evaluate tables of y = sin x with any num- 
ber of correct decimal places with the aid of a calculating machine. 

Since sinh x = —i sin ix, the expansions obtained for sin x lead 
us to the following expansions for sinh x: 


TES x? 72 112? 551x? 
ШҮК б de dO о e URS OE ОҢ S sev! 
x 6x 60x — 7x3 5880x 4- 620х3 
1 6-2 60—32 5880 — 36022 p Им 
and 
sinhx = x a а i —_ 
Ню 4r: e Baas 


х 6x-x? 60x-7x*  2520x 4-360»? + Их 


I 6 60 — 2x? 2520 — 60x? 


13. Fractional approximations for cos x and cosh x 


The general form of the expansion as a continued fraction of cos x 
is unknown. Only a finite set of the partial quotients of the expansion 
can be obtained by Viskovatov’s method. For example, 
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cos x = qoo zm ES alsi: 
1+2 - 6 + 50 = 16+... 
1 2 12— 5x 600 — 244x? 
1 24-23 1243 600+56x7 + 3x4 
and 
cosx = 1— x p = DE 
z 2+ 6 - 10 +126—...` 
1 2-2 12-53 120—56х%+3х4 
1 2 12 +x? 120 + 4x2 


Since cosh x = cos ix, the above lead to the expansions: 


з 5x2 3x2 31345 
2 


сөйг = Т = — 
TS + 6 - 50 + 126 -... 


1 2 12+ 5х? 600 + 244x? 
1 2-3 12-х 600— 56x? +. 3x4 


and 
cosh x = 1 + = È = Вх 
Е 2 - 6 + 10 — 126 +...” 
1 2+2 1245x? 120 +5624 3х* 
т 2 12 х? 120 — 4х2 


14. Fractional approximation for the error function 


The general form of the expansion as a continued fraction of the 
х 

error function erf x = NI e7? dt is unknown. Only a finite 
0 


set of partial quotients of the expansion can be obtained by Visko- 
vatov's method. For instance 


POE x 39x2 739x? 
rd “T+ 3 - 0 + Т: 227234 ы... 


x 3х 30x — хз 210х + 1105 
1 34x? 30+9х2 210+ 180x? + 39х* 
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15. Conversion of Stirling’s series into a continued fraction 


Let us take the Stirling series (see (6.509) and (6.516)): 


inI(x)- (=) in —— Ш 27+ х), 


where 


E NES Bun 
IQ) = a3 зда Ке Ноян с 


` 


and B, By, ... are Bernoulli numbers (see Chapter VI, $ 2, sec. 1, 
19): 
1 1 d zx 41 5 


6° B, = ^n = 


В, = — 30? By = се 


By using Viskovatov's method, we can convert the Stirling series 
into a continued fraction, the general partial quotient of which is 
unknown: 


2 2 


1 2 53 1170 22999 
+ 12х+ 5х+42х- 53x + 429x +...’ 


In F(x) = (=) РЕР СА Іа 2л + 


16. Fractional approximation for ће gamma function 


If we evaluate the coefficients in the expansion of the gamma 
function: 


Га +х = у сих" 
n=0 


1 се 
%=1, ee pe I Sh = Pu 


51 = C = 057722 (Euler's constant, see (6.56)), we obtain approxi- 
mately: 


I-rx)21—0:57722x--0:98906x? -0-90748хз +. 0-98173x4— ... 
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On applying Viskovatov’s method to this approximation, we obtain 
in particular: 

140°15141x +0:24392х2 _ 

PU+%) = 1072263032456 — 10 (5-49) 
This approximation is sufficiently accurate in many cases, аз is 
clear from the following table: 


x a+ T(x) x Г(ї+х) Т(х) 
—0-5 1-7725 17767 91 0-95135 0-95135 
-04 1:4892 1-4902 02 0:91817 091816 
-03 1.29806 1-29823 03 0.89747 0-89743 
-02 1416423 1116425 04 0:88726 0-88711 
—0:1 106863 1-06863 0:5 0-8862 0-8858 

0 1 1 0-6 0-8935 0-8927 
07 0-9086 0-9071 
H 1 0-994 


17. Fractional approximation for the logarithm of the gamma function 


Approximation of this function on the basis of Stirling’s series 
requires a knowledge of In x. However, it is possible to obtain a 
simpler approximation by starting out from the expansion 

eo (| тулуп 
diga = -err y CD. (5.50) 


n= n 


оо 

where s, = У 1/т", C is Euler’s constant. On evaluating the 
т=1 

coefficients, we obtain approximately: 


In Г(1++х) = ~0°57722x +.0°82247x? — 0:40068x5 + 0°27058х%—.... 


On applying Viskovatov’s method to this approximation, we obtain 
in particular: 
— 0-57722х + 0-59769х® 
1+0-38941х- 0139283? ` 


inZ(14-x) = 


284 MATHEMATICAL ANALYSIS 


Hence 


— 0:25068x + 0°25957x2 


le Г@ +хҖ) = 77939042 — 013922 


= TQ) (5.51) 


The accuracy of this approximation is clear from the table. 


x le Г(1+х) T(x) x Ig Г(1+х) T(x) 
-05 0.2486 0-2469 0-1 1.97834 1.97834 
—0-4 01730 , | 01725 02 1:96292 1:96293 
-03 0.11329 0-11321 03 195302 1:95305 
-02 0-066039 0-066029 0-4 `1-94806 1.94818 
-01 00288268 | 00288266 | 0-5 1.9475 1.9479 

0 0 0 


18. Fractional approximation for the derivative of the 
logarithm of the gamma function 


In accordance with (5.50), the function 
Po) = A490 
dx 


has the expansion 
(х) = —C45x— 59+... +(— Dis ax" ..., 
from which it follows that 
Wx) = —0°57722 + 1:64493х — 1-20206х2 + 1-08232х3— .... 


On applying Viskovatov’s method to the last approximation, we 
obtain in particular: 


— 0.57722 + 1:25687x 


1X96738x—0166703 ^ 709 (5.52) 


W(x) = 


The accuracy of this approximation is clear from the table. 
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x P(x) T(x) x Px) T(x) 
—0-5 —1-964 —1:938 01 —0-4238 —0-4237 
-04 —1-541 —1-538 0-2 —0-2889 —0-2890 
-03 -1:225 —1218 03 —0-1692 —0-1687 
-02 —0-9650 —09647 | 0-4 —0-0614 —0-0600 
-01 —0-7549 —0-7549 || 0-5 0-0365 0-0396 

0 —0-57722 —0,57722 


19. Obreshkov’s formula 


A knowledge of the general form of the partial quotients of the 
continued fraction into which a given function can be expanded is 
not sufficient for a determination of the general form of the conver- 
gent of this expansion. Nevertheless, the general form of the conver- 
gent can be found in certain cases. The most general approach to 
this problem uses Obreshkov's formula, which is one of the general- 
izations of Taylor’s formula. Obreshkov’s formula is 
у (- c (x- zm Nw Ру = у ст. Ch 


ved vad СА. m+k 


f (x— y (xp ESOR а, (5.53) 


(х— Ex + 


MIS 


Determination of the rational fraction approximations of a power 
` function with the aid of Obreshkov's formula. We put xy = 1, f(x) = х" 
їп (5.53), n being any real number. Now, 


т СУС 
xh м э Chik чел 
Е СТС (х1 * 
— ре А" 
3 ) Ст-ь х? 


When т = К, this equation becomes 


k TOIA 
> ChCh (х—1)* 


>= 8 
Хе УС (х—1)” ` 


Cir ur 
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In particular, when k = 1, 


2—n4nx 


Won CE. 
TUM n4 (2— n)x s 


For instance, when x = 2 and и = 1/3, we have 42 = 14/11 ж 1:273 
(the accurate value is 172599. . .). 

Determination of the rational approximations of the exponential 
function with the aid of Obreshkov's formula. We put xg = 0, 
f(x) = е in (5.53). Now, 


In particular, when m — k, 


2k(2k—1). . . (Е+1)+СЩ2Ж—1)...(К+1)х+С2&—2),..(К+1)х®+ ...х® 


~ wa.. «(ed D — CLR 1) . , . (k+1)x+C}(2k—2) , . (Е)... (T Dex 
(5.54) 
Using the relationship 
tanh x — быс! 
ёх +1 


together with (5.54), we get 
CiQk-1) (2k-2). . . (k+ 1)x— Cie -3) (260—4)... (К+1) 453+... 
KQQK—1) RAD RACHA CHD (263) (CR O2 RC 020-4)... К+1)8х4+... 


tanh x = 


On replacing x by ixin the last equation and dividing the right-hand 
left-hand sides by i, we get the general expression for the convergents 
of the expansion of tan x as a continued fraction. 

Determination of the rational fraction approximations of the 
logarithmic function with the aid of Obreshkov's formula. We put х= 1, 
f(x) = In x in (5.53). Now, 

Ch (х—1)” P & Сү (x-1Y 


m 
хә -iy i * 
Ы of ) Chk у „21 Chik  YX 


In particular, when m — k, 
L3 v» = ру 
nxs Y Ck ra a 


1 С х » 
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For instance, when k = 1, 


When А = 2, 
х2 — 1 


Јах = Du 


(6х — х®— 1) 


$ 4. Matrix methods 


1. Extraction of the square root by means of second-order matrices 


The theory of continued fractions is built up with the aid of the 
fundamental recurrence relations (5.2). It seems natural to consider 
generalizations of continued fractions, based on other linear recurrence 
relations, connecting the numerators and denominators of neighbour- 
ing convergents. Let us consider in more detail the relations 


Py = Pai +В Олл 


с лу, 5.5 
Qn = У.Р, + 02-1, } ш ) (5.55) 


These equations can be written with the aid of matrices in the form 


P, [zu n B. Pa э 
( E (= 553) (п = 1, 2,..). (5.56) 


We put ах, = A, Ên = и, Yn = 1, = a (n = 1, 2,...). Relations 
(5.55) and (5.56) now become respectively 
Р = GPy_y+uQn-i 
On = Pair t+aQn_1 


Pa (a Prat A 
OEE) ereo ез 


When а = 0, the process (5.57) is divergent. We shali therefore 


assume that a # 0. If lim P,/Q, exists, it can be equal either to Ju 
no 


} (n=1,2,..) (5.57) 


and 
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orto — Ju. Consequently the process (5.57) is divergent when а < 0. 
Let us use the notation 


-Vu =% Ми = x. 


We now have four cases: 


Р, 
la>x, х < = = 01; 
о a К 
2) 0 <a < Xz; lim =" = x; 
n= ое Cn 
Poan- Pon Ром Pont Ж 
- <= — <х <; 
Öm- Qu ^ Qu. Оша 
3) х <a<0, 
Ри Ponsi Pan Ponz 
—— <<<; te 
Qen-1 От: 1 Om Ом lim Pa zx 
P. P n œ Cn 
4 а= х Lx 
О» "n 
For example: 
1) а> х, 
5 22 5 47 455 4409 
1 5) 1 10 97 940 
5 4:7 46907 4-69043 
4/23 = 469043; 


2) 0=а=ж, 
5 27\ 5 52 26 265 2702 135 
110 5 5 50-2 


1 
5 52 519607 519616 
5119607 = 4/27 < 5-19616; 


3) x <а=0, 
-1 2-1 3 -7 W —4l 
( 1 at "b 182 55 оО. 529, 
—1 -15 -14 -1416 —14137 
- 1416 < —/2 = — 1:4138; 
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4) a < м, 
(i J 22% 1 -% n 
1-2) i 4 15 — 56 
—2 —1475 —1-734 —1-73214 
~1-73214 = – 4/3. 


2. Solution of quadratic equations with the aid of 
second-order matrices 


Let us puta, = а, B, = —4, y, = 1, д, = a+p in (5.55). Relation- 
ships (5.55) and (5.56) now become 


Pa = aP a7 Qn- } 
On = Р,_, +(а+Р)О,_; 


(ее) 99 
Qn la+p/\Qn-1 
If lim P,/Q,, exists, it can only be a root of the quadratic equation 


noo 
x24 px+q = 0. Consequently, when р2— 44 = 0, the process (5.59) 
is divergent, since the roots of the quadratic equation are complex 
in this case, while a sequence with real terms cannot have a complex 
limit. 

Let us write 


En „_-р+уйШЫ 
Е Qc cs В 2 . 


(5.59) 


and 


x 


When а = (atx), the process (5.59) is divergent. When the pro- 


cess is convergent, we have four cases: 


Р, Р, 
1) a> Xy х а Ve SE i 
P 2 On Qni 
2 BE 2а < xy lim 2% = хь; 
2 п> æ Un 
Pon- a Pan c __ Рљ+л < Pani à 


Üuc Qu. ^ QR Quo 
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3) xy <a< xtX, 
2 
Р Pansi Pan Pano P 
<< Xx -—— 5 lim = = x 
Qon-1 Qni Е О» Qon Tin i 
4) а=, fur oat Жү; 
Ол-1 я 
For instance, the equation 
х2 +2х-1= 0 


has the roots 


жа = —14J2 or xe —2414 and x, = 0-414, 


1) a> х, 
ыр. Иа E mS 
7741337472 7 24 12, 
1 05 043 0417 
2) zr tu. NN 
2 
-o(0)912 5 
а= eo PT. 2 5 P 
0 0-5 040 0417 
3) х<а—< + ж 
2 
Log [72 N2 5 22 2. 
dete 10) т = 5 —12’ 
—2 -25 —240 —2-416 
4) а=х, 
23 [$ INES 10_5 1 %®_ % 
атчы сү ap ie c4 о. 4^ ЕР 


—3 — 2-5 — 2-428 — 2-416 
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3. The connection between matrix methods and the theory of 
continued fractions 


Let us find the conditions under which the equations (5.55) can turn 
into equations (5.2). For this, we replace n by n—1 in equations 
(5.55), find Q,., and P, , from the relationships obtained, and 
substitute them in equations (5.55). On introducing, for brevity, the 
notation z, , Ó, ,—f, y, , = Аар we get 


р, = (=+ Ба Е = Pro (5.6) 
n=l т—1 
апа , 
dn- 
О„ = = Xn- + ôn Oaa nL Qa-a- (5.62) 
Yn-1 Yn-1 ` 


Equations (5.61) and (5.62) show that P, and О, can be taken as 
the numerator and denominator of the nth order convergent of a 
continued fraction provided that 


Уп Bn Bn Ул 
ani t+ n = y 0, Ьа meu. (n = 2). 
E bni ^ nw Ва-1 Yn- 


These conditions аге readily written in the form 


Zn — Ôn " ®„_1— дһ-1 2 m a — Oy 
Bo Ра А 

5.63 
Ba hal. A 

Yn Уа-1 A 

Hence the matrix 
An Bn 

E 5.64 
Ben za ! Ba ( ) 


is equivalent to a continued fraction, the partial numerators a, and 
partial denominators 5, of which are given by the equations 


а = pe (В._1уһ-1—%-18а-)) bn = E Ó, 1x44 (122). 
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We can find from the relationships 
( 0900) GJ =) 
yo 9,/N0 Уо 1 
C 5) a - ee 2 = Coo 
л ê 1 в + ё b, 


the zero and first partial quotients of the fraction. Hence the matrix 


and 


(5.64), in conjunction with the matrix f e) ,leads to the continued 
0 


fraction 


В» 
= — aô. 
Go ола --B,— XoXo + 81) Ё (7489 


— ё 
лю + Fi, + Ч 
Bn = ô. 
В, (Bn—1Ya-3 9 л-1) 
Mun шише (5.65) 
eec B,_, ona tn TE 
n= 


EXAMPLE 20. The matrix (i ij leads to V2 and is equivalent to 


the continued fraction 


11 1 
/2 = 1+= = = А 
T3433 pod ы 


In the theory of continued fractions, contraction is performed with 
the aid of the fairly complicated formula (5.9) and analogous formu- 
lae. Here, it is performed much more easily, with the aid of squaring, 
cubing, etc., the matrix. We have: 


1 2\/1 2\ үз 4 
z Б = 2.4—3.3 = — f 
G OG " C з) ка Паш 


b, = 3+3 = 6 (п = 2). 
The zero and first partial quotient of the new continued fraction have 
to be found directly, and not on the basis of this matrix, from a 
knowledge of the first convergents of the initial expansion for 4/2. 
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We get 


2 1 1 
Cag Gey 


On using the cube of the initial matrix, we get 
3 4\/1 2 2 7 10 
23/\1 1 \5 7 


43 =1 5 1 1 
TOS Yd beu 


4. The reduction of quadratic surds to non-periodic continued fractions 
by means of second-order matrices with variable elements 


The results of the previous section enable us to obtain as many 
expansions as desired of irrational square roots as non-periodic 
continued fractions. 

EXAMPLE 21. The matrix 


т Xa) 
(, +1 1 ) 
satisfies conditions (5.63). In addition, it leads to the equation 
Pa, ES Pait Xn 194a 
Qn (n + 1)Pa-1 TOi ч 
from which it follows that lim P,/Q, = /2. The equivalent continued 


п> oo 


fraction (5.65) has the form 
2 21 817 15.31 24.49 
VEI ISO oo ea ss: 
(i — 1) (202 — 1) 
zx 2п +1 Ф 
Similarly, by starting from the matrix 


n An 22) 
s n g 


we get the continued fraction 


8.3 (à — 1) 2 +281) 
ПЛ... + 212 — 1 +... 
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5. Extraction of the root of any rational power by means of matrices 


Extraction of the cubic root with the aid of matrices. Let us consider 
the three sequences {Р,), {Qn}; {Rn} the terms of which are connected 
by the relationships: 


Pr = aPp-1 IOS ER 
On = Pa-1t@Qn-ittRn- (n= 1, 2,...). (5.66) 
Ry = Pay +Qn-1+4Rn-1 


These relationships may be written with the aid of matrices as 


Px at t) (Pr; 
Qi = |1 а f] | В: (5.67) 
К, та) (К, 
Let x = Ши P,/Q, and у = іш Q,/R, exist and be finite. Now, 
n co n> оо 


х= iff, y= Yi. 


EXAMPLE 22. Let а = 1, t = 2. Then 


122 1 5 19 73 281 1081 
112 14 15 58 223 858 
111 13 12 46 177 681 


2/4 approximately 1 1-67 1:583 1-5870 1-58757 1-58737 
8/2 approximately 1 1-33 1-250 1-2609 1.25989 1-259912 


It is well known that V2 = 12599210, 4/4 ~ 1:5874011. 

By utilizing the square, cube or a higher power of the initial matrix, 
the convergence of the process can be strengthened as desired. 

Extraction of the fourth root with the aid of matrices. We generalize 
relationships (5.66) and consider the following equations: 


Qn = Pai Qna RR ESL 
Ry = Pait Q at aRS a Sas 
Sn = Ри-1 sci Rao Ss 


Р, = aPp-1t tOn- +18 1+1 | 
| (з =1,2,...). 


We сап write these with the aid of matrices as: 
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Pr a t t [| (Pay 
On) |l at 1 | Ол 
Ra 1 1 a t]| Ra 
Sn 11 1 a/ ‘5; 
Now, 
lim P^. ИВ, lim 22 УВ, lim 6/7, 
п = Sn п 5 оо Sa nee Sn 


if these limits exist and are finite, When а = 1, we have the matrix 


1]: t£ tV 1 143 141243 1431747312 4-2 
11: tfj 1 2-2: 34-12141 4 4- 40t 4-201? 
1 11¢f 1 3+ 6-10: 10441102 
1111/1 4 10+ 6t 20 +402 -- 4t?. 
Hence we can obtain in particular the inequalities 
£ 412t+3 61? + 10t 
— Wii 95 = из И StS) 
_ 6 +10: 12-121 4-3 
Zinn V5 660-089 


The domain in which we can apply these approximations is clear 
from the following table: 


11412143 612 +10 
£ 61 +10 vt 2412643 
1 1-000 1-000 1-000 
2 1-409 1-414 1-419 
3 1-714 1-732 1:750 
4 1971 2-000 2-030 
5 2:200 2:236 2273 
6 2413 2-449 2-486 
1 2-615 2-646 2-676 
8 2-810 2-828 2-847 
9 3-000 3-000 3-000 
10 3-186 3-162 3-139 
11 3:368 3-317 3-266 
12 3-549 3-464 3-381 
13 3-727 3-606 3-488 
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Extraction of any rational root with the aid of matrices. И may be 


seen, on generalizing the method above described, that the nth-order 
square matrix 


enables approximate values to be obtained for 


For example, to evaluate V4, we only need to carry out the fol- 
lowing working: 


122 22 2 2) 1 13 127 
11222 2 2) 1 12 115 
1112 2 2 2) 1 H 104 
1111222110 94 
1111122|1 9 85 
111111218 77 
1111111)1 7 70 


In particular, V4 = 104/85 = 1:223 or V4 ~ 85/70 ~ 1:214. The 
accurate value of this root is 1:219... . 

The convergence of Euler's algorithm. The method of extraction of 
roots of any rational degree with the aid of matrices was first pro- 
posed by Euler (though not in matrix form). The conditions for its 
convergence were recently obtained by L. D. Eskin. In particular, he 
showed that Euler’s algorithm is convergent for any г> 0 provided 
only that the zero approximation be chosen by a reliable method. 
Furthermore, Euler’s algorithm is convergent for complex г, which 
enables it to be used for approximate extraction of roots of complex 
numbers. 
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6. Solution of cubic equations by means of matrices 


The matrix 
ац а» @3 
а а d» (5.68) 
Яз 93 as 
eads to the equations 


aX Ty +43 


2 = kt Amy s (5,69) 
ах + Ago) + G33 


ma. уе йзүХ + daz +233" 


On eliminating x from these equations, we arrive at a third degree 
equation in y. Consequently, the matrix (5.68) can serve, when the 
corresponding process is convergent, for approximate evaluation of 
one of the roots of a third degree equation. 

We can readily obtain from (5.69) the equations 


— 1+ en mx (ans — as) dos — аза 


d 231X + Asay + Ass 
xm yd: (аһ — Gy) * + (аь— 422) + 413 — das 
аух + 32 + 433 


Let us require that the condition у? = x be satisfied. For this, it is 
sufficient that the equations obtained take the form 


433—433 (das — a3) 
= 14+—**—_,, x= ————— . 
d ах + 32 + ag E 031X + аз + 33 
Now, 
йоу = ау, Q22 = ау, yy = Чу, — 013 = а 
aiz 77 Azo = 33 — agg: 


Matrix (5.68) takes the form 
а: 42 3 — Яз Aig 


ay а 43|. (5.70) 


It leads to the equation 


апу? + (Gog — a)y? + (аз — азә)у — ауу = 0. (5.71) 
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Let us put, in particular, ауу == а = 1 and let us write a—1 = p, 
аӊ = — 9. The matrix (5.70) takes the form 


| -р-а —4 
1 1 -4|. (5.72) 
1 1 p+i 
It leads to the equation 
Y-4pyq-0. 


When p = 0, q= — г, the matrix (5.72) becomes the matrix for extract- 
ing the cube root. 

EXAMPLE 23. Let us apply matrix (5.72) for obtaining approximately 
one of the roots of the equation x*— x —1 = 0. We have 


121) 1 4 12 37 114 351 1081 
1 11j 1 3 9 28 86 265 816 
110j1 2 7 21 65 200 616 

1 L5 1285 1:333 1:292 1:325 1:324 


Notice that the convergence of this method is only rapid when 
the equation does not possess two roots close to one another in abso- 
lute value. 


7. Recurrent series. The Bernoulli—Euler method 


A power series X a,x", the coefficients of which, as from a certain 
п=0 
п, are connected by the same linear relationship, is described as recur- 


rent. The following theorem holds: the necessary and sufficient condition 


Jor the sum of the series У a,x", convergent for | x | < 1, to be a rational 
n=O 
function of x is that the series be recurrent. 

D. Bernoulli and Euler applied recurrent series to the solution of 
algebraic equations. Cauchy provided the basis of the method by 
indicating that, if x, is the root of least absolute value of the polynom- 
ial Q(x), the radius of convergence of the series 
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where P(x) is a polynomial having no roots in common with Q(x), 
and the degree of which does not exceed the degree of Q(x), is given 
in accordance with d’Alembert’s test by the relationship 


i; a, X. 


п->»=° д 


from which it follows that 


an 


x = lim 
п о @п+1 


For instance, Euler solved the equation x*—3x--1 = 0 by using 
the following expansion: 


1 


се ыш 2 LN 5 
EXE. m 14- 3x 4-9x? + 2633 + 75x* + 216х + 


+ 622x* + 1791x? 4-515728 + 148499 + 
44275639... = Ў ах", 


п= 0) 
Here x, = lim a,/a,,,, where x, is ће root of least absolute value 


n 
of the equation x?—3x--1 = 0. The convergence of the process is 
clear from the following table: 


a, 


an+ 


0:333 
0-333 
0-346 
0-3467 
0.34722 
0-34727 
0-347292 


мо tà WH o 


On replacing x by 1/x, the same method can be used to find approxi- 
mately the root of greatest absolute value of the equation Q(x ) = 0. 
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The convergence of the Bernoulli-Euler method is also only rapid 
when the equation does not have two roots close to one another in 
absolute value. 


8. Connection between the Bernoulli—Euler method and matrix methods 


Let us find by the Bernoulli-Euler method the root of least absolute 
value of the equation x*4- px-- g = 0. For this, it is sufficient to expand 
l/(g4-px4- x?) as a recurrent series. We have 


I 


Wipas = Ag + Ayx + Agx? + ИХ 


On equating coefficients of powers of x, we get 


1 
Ay = FE ЧАРА =0, 44 +рА = 0. д4 +рА t 4 = 0. 


and in the general case: 
ЧА, t PÁs + An- = 0 (n z 3). 
This relationship can be written as the matrix equation: 


ба 90) (An-s GAn—2 
00 а||4һ-»| = | Ján- 
-1 0 =P Ал-1 gAn 
But this equation gives only one new coefficient A,, while the two 


preceding ones are repeated. Ontaking the cube of the matrix com- 
posed of the coefficients, we at once obtain three new coefficients: 


0 q 0)? An-3 ФА, 
00 q An-2| = Any , 
-10 -p Án; PAn 
1.е. 
Ф 0 р? An-3 d As 
=p} Ë -p4 | | An-2| =| Anr 
p —pq 2+9?) (А-1 4зАл+. 
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On applying this method to the equation x*—3x—1 = 0, we get 


-1 0 3) 1 26 622 14849 
—3 —1 9| 3 75 1791 42756. 
—9 —3 26) 9 216 5157 123111 


An even higher power of the initial matrix can be taken; this still 
further strengthens the convergence, though not all the coefficients of 
the recurrent series are utilized in this case. The elements of the matri- 
ces obtained can be divided by the same number, since we only need 
the ratios of neighbouring coefficients. But the series obtained here 
will in general differ from the recurrent series, into which 1/(g - px 4- x?) 
is expanded. 

On replacing x by 1/x, the same method can be used to evaluate the 
root of greatest absolute value of the equation x?--px--q-— 0 (if 
the corresponding process is convergent). 


9. Solution of higher degree equations by means of matrices 


We can use a method similar to the above to form nth-order 
matrices that can be employed for the approximate evaluation of 
the roots of an nth-degree equation. For example, the matrix 


k la, 0 0 0 0 0 0 
0 k lay 0 0 0 0 0 
ооо la, 0 оо 0 
0 оо К lan 0 0 0 
0 0 0 .. 0 k la, 0 0 
0 0 0... 0 0 k 0 lan 
—lay — іар — 1... — laps — lan- — lag a k— аһ: — lana 
0 0 о... 0 0 0 la, k 


can serve, when the corresponding process is convergent, for approxi- 
mate evaluation of one of the roots of the equation 


аах" Maj ax" т... Ках фар = 
For example, in the case of the equation 
xt— &3 p x*— x41 = 0, 
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we obtain on putting k = 7 = 1: 


оо 101 2 4 и 58 455 
0 1|] 101 2 7 4 37 3500 
9. 1] 1(84 35 310 2753 24463 217403 
1 1 1Q)1 5 40 350 3103 27566 

1 4 7 775 7-866 78837 7-8866 


The exact value of this root is 78873... . 


10. The idea behind Jacobi's algorithm 


Euler posed and partially solved the problem of finding the solution 
in integers of the equation aX; Нах, ах, = 0. Jacobi posed the 
analogous problem for the equation 

AIXI HAX +... хь = 0 
and developed for this purpose а special algorithm, which is a gener- 
alization of the algorithm of continued fractions. In particular, Jacobi 
assigned to this algorithm the following form: 


Uni = Ул Рав, 
Yaar = Wn Inns | 
Wn+1 = n. 

Here, p, and 4, are positive integers, chosen in such a way that 


Ung, and v,,, are the least possible positive numbers. With the aid 
of the numbers p, and q,, we form the following relationships: 


An = 4ь4Ал-1-ЕРа4Ал- + 4һ-з› | 


(5.73) 


В, = daB i PnBa-2 + Въз, 
Ch = 4„Сл-\ +PnCn-2 + С, -3» 
B., B4, By 


100 
=|0 1 Ol. 
Ca C4 €) 1001 


In this case, when Jacobi's algorithm is convergent, 


(5.74) 


We suppose that 
bc А: № 


P. и . 
lim lA = Ll x lim = = +. 
з Ca wi п Са Wy 
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Jacobi’s algorithm enables us to find fairly small integers 4,, B,, 
С, approximately proportional to the given large numbers u, Уу, Wy. 
EXAMPLE 24. Let us solve approximately the equation 


х:у:2= 49:59 :75. 


We have, on using Jacobi's algorithm, 


п Un Ул Wa Pn Gn An В Cs 
—2 1 0 0 
—1 0 1 0 

0 0 0 1 
1 49 59 75 1 1 1 1 1 

2 10 2649 2 4 4 5 6 

3 6 9 10 1 1 5 6 8 

4 3 4 1 2 15 18 23 

5 1 0 3 0 3 49 59 75 

6 0 0 


Thus, for example, 5: 6: 8 = 15: 18: 23 z« 49: 59: 75. 

The order of filling up this table is as follows: we first evaluate 
ш 2249, v, = 59, w,=75 and A,, B,, Cp with n= —2, —1, 0. Next, in 
accordance with algorithm (5.73), we evaluate ру, qi, us, Уз, Wa. Then, 
with the aid of relations (5.74), we evaluate 41, B,, C,. Next, in accord- 
ance with algorithm (5.73), we evaluate ps, qs, Us, Va, из. With the aid 
of relationship (5.74), we evaluate 45, B}, Cz, and so on. 
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SOME SPECIAL CONSTANTS 
AND FUNCTIONS 


THE present chapter contains information on real constants and 
some real functions commonly encountered in analysis.t 

Our treatment must take into account the fact that differing defi- 
nitions are current in mathematical literature. For instance, the 
generating function of a sequence of functions is usually defined as 
the function of two variables f(x, y) for which the relationship 


fe) = Y ey, 


is satisfied in some domain of the x, y plane, i.e. the g,(x) are the 
coefficients of the expansion of f(x, y) as a series in powers of y (cf. 
the definitions of the generating functions of Bessel functions and 
Legendre polynomials), In other cases, f(x, y) is called the generating 
function of a sequence if 
fo,» = $ Po ym 
n=l x 

(cf. the definitions of the generating functions of Bernoulli and Euler 
polynomials). 

There is also a lack of uniformity as regards the notation for 
various functions. In such cases the different notations will be quoted, 
though only one of them will be utilized. 


1 Information concerning functions of a complex variable will be given іп a 
later volume. 
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§ 1. Various constants and expressions 


1. Some well-known constants 


1°. The number л: л = 3:14159 26535 89793... 

The number z made its appearance in connection with the calcula- 
tion of the length of a circumference by finding successively the 
perimeters of the inscribed and circumscribed regular polygons with 
2" sides. z is a transcendental number. 

Some approximations for the value of z: 

z = 22/7 (Archimedes? number); 

л = 355/113 (Metsiev's number). 

Some representations of zt as series and products. On putting x= 1 in 
the power series expansion of arc tan x, we get the Leibniz series 


кыекы ыы. ссора Е 


= 3*377 Tee. (61) 


With x = 1/4 3, we get from the same expansion 


л 1 1111 11 
a alisats 3-7 et u$ J (6.2) 
Since л = 16 arctan (1/5) —4 arctan (1/239) (Machin's formula), 
we have 
л = 16/4 11 Ll ЕЕ . 
COS qs S sp» а 
1 1 1 
А -4(5-звя +... (6.3) 


Wallis’s formula is 


To Qn! P 1 
To [ге | pr mo 
As a continued fraction: 
л 1 P P п? 


4 1+3 +5 +... +241 .. 


(6.5) 
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Other relationships are: 


1 - Хак {ап = А (6.7) 
t : = > arc tan IT (6.8) 
= танз (6.9) 
0 = 0 = ES 
с> са сы, 

LO A UR PN би 

2 UR E 
= По o (6.13) 
= = + Es gnum eem AGT) 
= 2 ic (6.15) 

2 ос 

Ж” L E iy (6.16) 
= = Eco | (6.17) 
102 Yee (6.18) 
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Зл? ы 1 

== 1-2 {жет (6.19) 
m$ _ 1 1 1 1 
16 21719513985 ШЕ ЖД (6.20) 


3л? 1 1 1 


1 
256 "9 ix "xem wma 5 (920 


Inequalities connected with the number л. И a, 2:0 (п=1,2,...), 
but not all are zero, we have 


D a) зеў т (622) 
n=] n=l n=1 


л? being the best constant in the sense that there exists a sequence a, 
for which equality is attained. If f(x) = 0, f(x) #0, /Є12(0, œ), 
xf €L, (0, =), we have 


4 
| "родах = E | MIC all f Dm (6.23) 
0 o 


9 


where л? is the best constant in the sense that there exist f(x) for 
which equality is attained. 


Integral forms of л: 


л * tan x 
> = | x dx. | (6.24) 
л < sin x cos mx 
5 =f ERAI CE dx, т = 1. (6.25) 
fpe (62 
о = , 29 x. (6.26) 


i E = p sin (x?) dx — F cos (x?) ах. (6.27) 
° D 
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= a= ә cos X 
rt oua rs 
x. [еек 
2 ° 


z-[ In (1 +x) dx 


x 


2°. The number е: 


е = 27182818284 59045... 


Euler's number e is defined as the limit 


1\" E 
e — lim (1+2) = lim (1+о)%: 
п а—0 


п > = 


е is a transcendental number. 


(6.28) 


(6.29) 


(6.30) 


(6.31) 


(6.32) 


(6.33) 


(6.34) 


(6.35) 


(6.36) 
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Expressions for e, её, е, (1+e)* as series and products: 


Pma = 1+ mp 


Р1=1, Po=2, рз=5, р= 15, ру= 52,.... 


1 1 


_ 2(4\*/ 68 үу 1012.14.16 үз 
CSTs 5.7 9.11.13.15 


E 1 y ntl 


3 n=0 п! 
2+2" 
(1e Е? xi 


+m OTC) 


ТЕТЕ 1/а(а + dY(a4- 24)... [a 4- (n— 1] 


"= L7 (a+ kd) 
П iao 
11 1 
+6+10+...+ 2Qnl)z... 


0 
71-3 
(continued fraction). 

Some inequalities. When 0 = t £ n: 
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(6.37) 


(6.38) 


(6.39) 


(6.40) 


(6.41) 


(6.42) 


(6.43) 


(6.44) 


(6.45) 


(6.46) 


(6.47) 


(6.48) 
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When u, > 0: 
2 
0= i-e (1-5) ==. (6.49) 
ў Muss Un 
Е Ша (6.50) 
Уи 
n=l 
lim sup A i = е. (6.51) 
n=» оо иң 
Minima: 
min xX = е-1, (6.52) 
ОЕх< ое 
min -> = e. (6.53) 


о<5<% ах 


The number е is the base of logarithms with which the inequality 


is satisfied: 
log ax = x—1 (Ostrogradskii). (6.54) 


The functions e* and e~* are defined as the limits 


Xn " хү 
ех = lim (+3) , €7* = lim up š (6.55) 
n- оо n n— оо n 
3°, The Euler-Mascheroni constant С: 
С = 0-5772156649 015325... 


The Euler-Mascheroni constant C is defined as the limit 
a mo 
С = lim (2 —- ит), (6.56) 
т->=е\тп=1 П 


the existence of which follows from the convergence of the series with 


general term 
ntl 


g(n = l- | t71dt. 
n 


It is unknown whether C is rational or irrational. 
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Integral forms. Since 


1 рт ("D fi. уу, 
5 te | на = ["[1 ( 2) р йу 


PEE шт = ИЕ zi ydy- (a) ee 


from which we find, on passing to the limit, that 


С = Га = е-%)у-1 e [e dy (6.57) 
0 


1 


C= | (ее) ii (6.58) 
0 


It follows from (6.58) that 


or 


c= f "(1 —e7971— ert dt. (6.59) 
о 
Other integral forms. 
C= — | e-tlntdt. (6.60) 
0 

C= 1 + 1 dt. 6.61 
crier i ds 

- 1 \а 
c= -f (cos А тат) (6.62) 

æ / sint 1 dt 
C= isl (F m) (6.63) 


c= P eK. | (6.64) 
0 
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€ = | (те — =) a . 
^ +t t 
= 1 
С = ЕТ = End dt. 
о\е-1 t 


1 1 
С= =| In In — dr. 
% t 


С= о (= arc cot =") Miz In p. 
me t 


С = F (5 arecott— cos pr) dt —1n p. 
0 л 


С= Ня | чага. 
л | t 


The asymptotic expansion is 


С Ey fc Жы ue 
Т. п 2m 12m? 120т* `7 
Ba 1 Bongo 1 
nak 2n mn +8 2n +2 тт+?? 


Infinite products expressible in terms of e and С are: 


as E. (онеш т) m 
П 1 = lim > 1 
ї11+— "7° (1+4) 
п 1 
еб lim -———— 
n 
1 


: t n т 
С = lim 1-0 = ТЕ ty 


1—0 


4°. Catalan’s constant С: 


G = 0:91596 55941 772190.... 


0=9 = 1. 


in 


(6.65) 


(6.66) 


(6.67) 


(6.68) 


(6.69) 


(6.70) 


(6.71) 


(6.72) 


SOME SPECIAL CONSTANTS AND FUNCTIONS 313 


Catalan’s constant G is defined as the number 
1 
G= f n (6.74) 
0 x 


An expression for Catalan’s constant as a series can be obtained 
by expanding x^! arc tan x in (6.74) as a power series: 


> —im 
= —-. 6.75 
б = 2. отту T 
Other integral forms are: 
1 f"? tdt 
Gas | =: (6.76) 
л aja 
а) t tan t dt. (6.77) 
0 
л vÍ4 
G= inno t cot t dt. (6.78) 
° 
л [2 t dt 
tG = -.h 2+ н (cos Ешй?” (6.79) 
л [a t dt 
a= get о а t+cos D sint" 6.80) 
л PES 
G= -5 № 2-2 | In sin t dt. (6.81) 
0 
ЖЕ uL 
G= == In 2+2 | In cos ¢ dt. (6.82) 
0° 
. ] (lz л 
+@ = 2) tn (1+ cos t) dt+ T In 2. (6.83) 
0 
*[2 ES 
а = | In (1-- tan £) dt— 7 ln 2. (6.84) 
0 
1 Int 
G= -f я dt. (6.85) 
NES 
шыш ылыш (6.86) 


o /1-` 
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G = ig № (1+0) — e- = In2, (6.87) 
бы TM | (6.88) 
л In (1-9 
б -—1n2-| — dt. (6.89) 
8 | 1+ 
1+ dt 

G- | ee (6.90) 

3x 1 1+ dt 
G- +2 2+5 |, ET 1ш. (6.92) 

o 
G= Г UL M жЕ m2, (6.93) 
arc tan t л 
G= Eoo й+ S In 2. (6.94) 
G=- f "шеш ae (6.95) 
0 
G= gere (вошь. (6.96) 
0 
1 
а = 2| (Scams) 5a n? (6.97) 
о 

zo 1 fe at 
G= era] (are tan D MH (6.98) 

Oz [е 2 tdt 
G= wx]. (arc cot t) VETA (6.99) 


Expressions in terms of complete elliptic integrals (see (6.380) and 
(6.381): 


а [ ` K(k) dk. (6.100) 
2 0 


G= | ЕЮ dk — 1. (6.101) 
0 
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2. Soumne merical expressions 
1°. Factorials. When n is a positive integer: 


п! = 1.2.3...1. (6.102) 
Ву definition, 
0! = 1. 


The gamma function is а generalization of the factorial (see § 4, 
sec. 5). 
When т is a positive integer: 


Qm)! = 2.4.6...2m. (6.103) 
Qm-- 1)! = 1.3.5... Qm4 D. (6.104) 
(2m)! = 2тт!(2т—1)!! (6.105) 


The number n!! is called the double factorial of n. Expressions for 
factorials, inverse factorials and their sums: 


>, 1 
anl 2 т(т-+ 1)... (m+n) ` (9:109) 
n 
(n+1)! = +d kk! (6.107) 
=] 
оо 1 e+e! 
Ў ap = cosh = 154308... (6108) 
se 1 e—e . 
Хе = а = sinh 1 = 1175201... (6109) 
y CD cos = 0:54030 (6.110) 
х" = a | 
= 1 
— “1 = gj = 0: 
Херт = 911 = 084М47.... (611) 
Ут = м2) = 227958530... (6.112) 
na (nl) 


ыы 1 


2. FICESVI m 1(2) = 1590636855 . . oe (6.113) 
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= 1 
> naor = A9 (6.114) 
2 em И = J40) 022389078 . ... (6.115) 
ег аа = ЛО) = 0:51672481.... (6116) 
ec (- 1)" 
xn niger 7 AA (6.117) 


Inequalities and asymptotic formulae: 


[zy <n! < en Ө (6.118) 


т ae (6.119) 


(2n)! 

Gm ^ (6.120) 
ix ym YC tue ) (Stirling). (6220) 
(2n—1)!! = Ji Onye "1m, 10, | = 1. (6.122) 


nh 


о | 0 
п! = Jin Te тап (Gauss). (6.123) 


A formula for the logarithm as a factorial: 


In n! = (+ [#[[#| (6.124) 


where the summation is over all primes р not exceeding n. ( [x] is the 
integral part of x. See § 3, sec. 1, 3°.) 

Divisors of a factorial. The greatest index with which a prime p ap- 
pears as a factor іп и! is 


Bera ee [| (6.125) 


where р" = n, but p**! >n. 
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For example, the highest power of the number 2 by which 50! is 
divisible is 
50 50 50 50 50 
HLH -° 


Thus 50! is divisible by 247. 
2°. The Kronecker delta 0" (or mn) is defined by 


1, п= т 
ёт =}, (6.126) 
ý | п + т. 
The integral form is: 
n 
on = | Pal )Pa(x) dx (6.127) 
а 


where {p,(x)} is a system of functions orthonormal in [а, 5]. 
For instance, 


m= al cos nx cos mx dx. (6.128) 


n 
3°, The binomial coefficients ( or С", where п is any real 
m 


number and т is a positive integer, are defined by 


(a) = n(n—1)...(n—m+1) 


m т!\ 


(6.129) 
When n is a positive integer: 


n п! 
i Е CEST (6.130) 


The beta function is a generalization of the binomial coefficient 
(see $ 4, sec. 5, 2°). 
Some relationships between binomial coefficients (п, m integers): 


(n) =0 fo п> 0, m>n. (6.131) 


m 
n n 
e = (nim) (6.132) 
n n n+1 
= ыы) (6.133) 
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ФТ У-Ү") вы 


(o )- (1 )+(: )- T€ (к ec n (6.135) 
ce (C yes (api) (6.136) 


n n "S 
(SG) |+... =2 T (6.137) 

n n n n- 
GP GIG) 1, (6.138) 
(PG) (rm (nis odd). (6.139) 


0 
(T) D EL 227-2 (n is even). (6.140) 


= (3—1 ^ sin =. (6.141) 
(GG) mm) (6.142) 
[ШУ rae tt) өө 
«e drm) өе 
(SG } p =). (6.145) 
GEE- y(r sin =). (6.146) 
(:)+(:)+ (1+... (в 2 cos). (6.147) 
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BEOL m). (6.148) 
-G-a rm (6.149) 
G-GHRG HG) 9m (6.150) 

Gele) оо") ао (6.151) 
("3-2 (F) (5)- .. *cocw(7) =0 (n1). (6.152) 
ADAG) atr) este m 
(ОнОна. em 
(2) те m 
(HG) FC) 
= 1+5... (6.156) 
(зуе) 
= 1424... +. (6.157) 
вые) е» 
(X) (G3) +(e) () * 
= (ns = oe (6.159) 
(S) «(1) +--+ н) (а) ғ (6.160) 
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ORONA ORSON 


2n+1\? /2n+1\? 2n+1\? 

( 2 ) ( | Jr) =. 
n\? nM n\? 
OL ORGEL = 


do E 


= 2n-2N _ (21-1! 
= (2n Je ‚= (nip 
Binomial and polynomial formulae: 
а а к= — anas, 
oe) пит %!%! аа 
(а+а&=...+а„)" = 
п\ 
= Se ир а ЖАРГЫ PL ni ene id О 
OS 9»! one vp! аиа dy 


Some identities in connection with binomial coefficients: 


$ a(n) нат = х. 


Е=0 
п kn 5 \ „1 
(+) а-я -(-„)* +7 x. 


я fk 2/n ась X073) 
E) (&)^о-® Маас кы, 


(6.161) 


(6.162) 


(6.163) 


(6.164) 


(6.165) 


(6.166) 
(6.167) 


(6.168) 


The Bernshtein polynomials B,(f) of a function f(x) are defined by 


the relationship 
B= E (T) va». 


(6.169) 


If f(x) is continuous in the interval 0 = x < 1, the sequence{B,(/)} 


is uniformly convergent to f(x) in this interval: 
lim B,(f) = ХХ). 
n co 


(6.170) 
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Asymptotic formulae. 
2n 22п 9. 
(=) e (6.171) 
1 
nts 
B аа н орва ее ELD 
т 2n т+1 п-+21. 
т %(n—m) ^? 


k 
nfn\k 2kn/ 2\ 2 
=} ~ =l > 6.173 
AG) ~ Zs) eS 
па 


пк+Г\  (k—ly f k 
К) єт 


Uo ) = парі Pe 79 Ой) ^ (6.175) 


Fibonacci numbers and the golden section. The sums 


[2] n—(k+1) 
= ў ( ) (6.176) 


are connected by the relationships 
ил = UQ cid Ua П> 2, щш = и = 1. (6.177) 
The numbers u, are called Fibonacci numbers. Binet's formula holds: 
2 2 
NH 


The following are consecutive values of the Fibonacci numbers: 


и, = ; (6.178) 


Uy, Из» Из»... 


1, 1, 2, 3, 5, 8, 13, 21,.... 


The Fibonacci numbers appear in the expansion as a continued 

1 1 
BESETTE 
have the form u,/u, (n = 1, 2,...). 


1 - 
fraction of the number [e 5-1) . The convergents 
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1 
The number « = 7 (v5 ~1) is occasionally called the number of 


the golden section. It is defined as the mean proportional between 
1 and its complement to 1: 


о? = 1.(1— а). 


И was supposed in classical aesthetics that, for instance, the rectang- 
le with ratio of sides х, or the ellipse with ratio of axes x, were partic- 
ularly pleasing to the eye. Hence the name golden section. 


§ 2. Bernoulli and Euler numbers and polynomials 


1. Bernoulli numbers and polynomials 


Special number sequences, e.g. Bernoulli and Euler numbers, prove 
useful for obtaining power expansions of numerous functions. 

1°. The Bernoulli numbers B, (п = 0, 1, 2, ...) are defined as the 
coefficients of the expansion as a power series of the function t(e'—1)71 
for |t| < 2л: Е 
а (6.179) 

ё—1 o 5n 3 

These numbers were first mentioned by Johann Bernoulli (Ars 
Conjectandi, 1713), inconnection with the problem of summing powers 
of the natural numbers. The numbers В figure in the power expansions 
of the functions tan t, tanh 1, t cot t, і cotanh f, etc., in the Euler- 
Maclaurin summation formula, in the asymptotic form of Euler's 
gamma function. 

There is no one accepted notation for the Bernoulli numbers. In 
certain works, B, is used to denote what we denote in the present sec- 
tion by | B, |, or В, or | Bey |. 

Recurrence relations. Using (6.179), rewritten in the form 


MET m. 
n-0 ar T 


cross-multiplying the series on the right-hand side and comparing 
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coefficients of powers of t, we find that 


CiaB,.CLaBS 1+... + Сй В-ы... 
... +С B+B = 0 (6.180) 
or, in symbolic form: 
(14 Вуе+1— pn*1-.0, (6.181) 


where, after raising to a power in accordance with the binomial for- 

mula, all the exponents of the powers are replaced by subscripts. 
Since 

e-+- (7 Nett = = = 


2Y B pr (6.182 
- ay ЕЕ (6.182) 


all the Bernoulli numbers with odd subscripts, п = 3, are zero. All 
the Bernoulli numbers with even subscripts are non-zero, B,, being 
positive for п odd and negative for п even (see (6.194)). 

Laplace’s formula 


1 

эт 1 0 s 0 

1 1 
зї 3T 1 0 

Ва = (—1)"п!| | 1 1 (6.183) 

d ar "T эт ... 0 
DET cs 
(n1! n! (n—1! 77 2! 


Bives an explicit expression for the value of a Bernoulli number in 
terms of its subscript. 

The Bernoulli numbers are rational. This follows, for instance, 
from the previous formula. 

SrAuDT's THEOREM. Every Bernoulli number B, can be written in the 


form 
1 
В„ = С„— MY (6.184) 
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where C, is an integer, and the summation is over all k > 0 such that 
К+ 1 is prime, k being a factor of n. 

For example, when л = 6, the factors of n are К = 1, 2, 3, 6. On 
adding unity to each of these, we get the numbers 2, 3, 4, 7, of which 


the primes are 2, 3, 7. Consequently, В, = 1—(1/2)—(1/3)—(1/7) = 
= 1/42. 


Some Bernoulli numbers: 


1 1 1 
В = 1, В, = =>, В, = =, В, = —30’ 
1 1 5 
В, = т, В, = – 27, Bo = е, 
691 7 3617 43867 
Ба = -ay Ви = ср, Ви 510, 018 798, 
g, = idet _ 854513 
ager: 330^ 2р3 ° 
236364091 8553103 
Рота D E CE 
в. 23749461009 —  _ 8615841276005 
mm 870 OSEE 143322 ^" 
7709321041217 2577687858367 
Bz = Mec Васи 
в. = _ 26315271553053477373 
Moe 1919190 й 
p, = 2929993913841559  _ _ 261082718196449122051 
m 6 c ng 13530 


Some power expansions with coefficients expressible in terms of 
Bernoulli numbers. Since > coth > t = {/(е—1)} +56 it follows 


from (6.179), after replacing t by 2t, that 
Z Bynt?” 


г соїарһт= 1+ У, ier 6.185 
Шс оа oe 
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it cotanh it = tcott, tant = cot t—2 cot 2t, 


t 
tcosec t = tcott+ftan—, 


tanh 7 = 2 cotanh 2t—cotanh t, 


cosecht = — cotanh/ — cotanh 5, 
we get 
5 CIA, 
tcott = 1 — n, |1 л. 6.186 
оаа мя. (6186) 
= (22 — 1)22 — 1-1 _ РЕ 
tant ut EE со Bynt”, [1|< 5 (6.187) 
се (2— 22") ( — 1)" 
t cosec t = т Вит, |1| = л. (6.188) 
= y MORAY y, pni z 
tanh t 32 Qni Bynt, || < Y (6.189) 
tcosech і = 1+ uaa B,u7 171, |t| < л. (6.190) 
ney, О! UU 07 


sin t а (-)"2# Вә on 
We о ©" 


р = л. (6.191) 


_ а (DPN 1) Ban 2 л 
est у о = en, || >, (6.192) 
tant > (—17+122 21-1 1) В. 
In —— = foe DA mm, du <5. (6.193) 


Expressions for the sums of some numerical series in terms of 
Bernoulli numbers. If we compare expansion (6.186) with 


Р го $1 
tetto 1823 uus m = 1-25 5 PE 


it follows that 
(—1)°-12(2я)! = 1 


Вы = (mm Ve mm 


(6.194) 
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The equations follow from (6.194): 
wol (— Dn71(22)m 
у = 


ey ma = лу Ba (6.195) 
È e om в = CU в, (6199 
b» Use E аа аа an: (6.197) 
In particular, é 
be Bree т. (6.198) 
ке E = A - =. (6.199) 
Las E EM Е =. (6.200) 
in = a (6.201) 
is = эң: (6.202) 
in = an (6.203) 


Some integrals expressible in terms of Bernoulli numbers. Integral 
Jorms of Bernoulli numbers. The relationship 


к 1 1;2n— 1, 
= ul. eg-mijan-id; 
leads in conjunction with (6.194) to the following relationships: 
es [21-1 
Boy = (~ IP м || a d (6.204) 
т 
= (— pcs |” (i-em (6.205) 


Bon = (— pip 121-? In (1— e72) di, (6.206) 
0 
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bur us pA т | ў tat (6.207) 
bn (7 D? atm f non dx. (6.208) 
By = (dye атры Ou d (6.209) 
m = (T D s | ш (6210) 
Ве = c» ІК (Io n-i са. | (6.211) 
Ban = (~1)"72 me (In гут gopi: (6.212) 
MES LY" qs n (in tan 07-1 => (6.213) 


Baa = (7 pi ОТЕП) | ‘mama. (624) 
0 


2°. The Bernoulli polynomials are given by the formula 
n 
B(x) = («+ BP = У Ө Byxn-, (6.215) 
Ато 


A number of authors consider, in addition to the polynomials B,(x), 
the polynomials 


Pn(x) = В„(х)— Bad (6.216) 
It follows from (6.215) that 
B,(0) = Br Pn(0) = 0. (6.217) 


The generating function for the Bernoulli polynomials is te*(e! — 
—1)7i Its expansion as a power series, convergent for || < 27, 
has the form 


Ld T 
te) = Y Bj) —. (6.218) 
MS n! 
The difference equation 


fet D—f() = nx- (6.219) 
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is satisfied by the Bernoulli polynomial. This follows from (6.218) 
and the relationship 


[e*t Diet — 1)-1 ее 1)-1 = te, 
Recurrence formulae. Differentiation of (6.215) gives 
BAX) = пВ,_1(х) (6.220) 
from which it follows that 


B,(x) = B,(0)-n [50 dx. (6.221) 


0 


Some Bernoulli polynomials: 


B(x) = 1. (6.222) 
Вү(х) = x-5. (6.223) 
Bx) xi-x4 T (6.224) 
3 1 
B(x) = Wm FMS х. (6.225) 
B(x) = ate diat uc. (6.226) 
25558. a soot. 
Вь(х) = х5 5+3 x e^ (6.227) 
Hej = sees t L (6.228) 
$ 2 2 42' ` 
7 7 7 1 
apt yh pe ИЯ 
Bix) = х zta gtg (6.229) 


14 7 2 1 


= х8— 4х? Ие Е yh 
B(x) = х8-— 4х? + 0-х ру. (6.230) 
9 21 3 
= x? — 2.38 y. CP. 
B(x) = х 3* + 6х E x*42x 70 ^ (6.231) 


Вуо(х) = xt — 5x? + > x8— 7х6 + 5xt— i x ES я (6.232) 
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Zeros of Bernoulli polynomials. The following formula holds: 
B,(1—x) = (— 1)"B,(), (6.233) 

from which, letting x = 0, we get 
B) = (—1)°В„ (6.234) 


and, since Bap} = 0, we have 


В„(1)- В, = B,(1) - В„(0) = 0 (6.235) 
for all n. 
It follows from (6.216) and (6.235) that 
Pn(0) = p(l) = 0. (6.236) 


It follows from (6.233) with n=2k+1 and х = 5 that 


1 1 
Borst (3) = – Borst (2) (6.237) 


1 
Panes (5) =0. (6.238) 


or 


The polynomials p,(x) with even subscripts vanish on the segment 
[0, 1] if and only if x= 0 or x = 1; ће ф(х) with odd subscripts 
vanish if and only if x = 0, x = P or x = 1. 

The polynomials p(x) with even subscripts are of constant sign, 
the same as that of (—1)*, on the interval (0, 1); the polynomial 


93x 41(X) has the sign of (— 1*7! on the interval (0 i) and the 
sign of (—1)* on the interval (5 ). 


A multiplication theorem for Bernoulli polynomials: 


m-1 5 
В. (тх) = т" У B, (= + x) . 


$20 
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This relationship follows from the fact that 


= B,(mx)^ e" _ | тт че +... Hem- _ 


nzo nl et—1 m emt — ] 
S nm 
Dm imag (+ ыш 6.24 
Sm ет = m 6, п! . (6.240) 


Trigonometric expansions of Bernoulli polynomials in the interval 
(0, 1): 


1 > sin 2лтх 
BO) tog Roe CL (6.241) 
1 < соѕ2лтх 
Bx) = Y Fa (6.242) 
ызы = 1 = соѕ 2лтх 
Олуг 40 = адат кыш (6.243) 
{=> 1 > sin 2лих 
Qni yi Baix) = Эът Pu (6.244) 


Integral forms of the Bernoulli polynomials in the interval (0, 1): 
> cos2nx—e-?" 

о cosh 2nt— cos 2лх 
(п = 1, 2,...). 


= in 2лх 
Bon O) = (mens | ЗШ edt (6246) 
iu о cosh 


Boy (x) = (—1)"°+12% 17-1 (6.245) 


2л1— cos 2лх 
(п=0,1,2,...). 


Application to the summation of powers of the natural numbers. On 
assigning to x in (6.219) the values 0, 1, 2,..., p and summing, we get 


È gi „ ВЮВ, 
en n 
or, on replacing n— 1 by z, 


я = Basi(ptl)— Baas 


А I (6.247) 
= 
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For example, 


ЕН 


$=1 3 3 
ыле (6.248) 
ў я " гаран ake — 29 + pt) = zo (6:249) 
Ran Вр, _ 1p Spip Pj. 
QU eC. a j- 
= App 2+ Зр 3р+0). (6250) 


S Be(p4- 1)— Bs m 1 6. 155 5 1 P Aet 
кешк = жайы йш | = 


2 Ppt 12р? +2р+1). (6.251) 


The Euler-Maclaurin formula establishes the connection between 
the integrals and the sums: 


[хә - [LO ўы]. 
0 


-'€ ai Veo) reo Em. (6252 


If f(x) and all its derivatives encountered in (6.252) tend to zero, 
while the derivatives of even order differ from zero and all have the 
same sign, the summation formula holds for m = <, if the sum and 
integral appearing in it are convergent. 

Stirling's formula is obtained from the Euler-Maclaurin formula 
if we put f(x) = in x in the latter and make the lower limit of integra- 
tion equal to unity: 


mai 
P Ink = minm-m- In (m+ 1)+ 
=1 


+ б By (m-?r*1 = 1) 


A хб лу ^ je (6.253) 
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When n = 2, it follows from (6.253) that the asymptotic Stirling for- 
mula for the factorial (see (6.121)) is 


1 
т! x ят" Зет, (6.254) 


2. Euler numbers and polynomials 
1°. The Eyler numbers E, (k= 0, 1, 2, . . .) are defined as the coeffi- 
cients in the expansion as a power series of the function 
не ae ore, (6.255) 
ney KIT 2 
Since the function sech ¢ = 2/(e'+e7) is even, it follows from 
this that the Euler numbers with odd subscripts are zero: 
Езтчл = 0 (т = 1, 2, ...). (6.256) 


Recurrence relations. It follows from (6.255) that 


> (т е rh 


1 = 2. Q à Е, т: (6.257) 
whence Е, = 1 and 
Eo + СЕ t СЕ +... + CR Egy Qd Ean = 0. (6.258) 
In symbolic form: 
(Е+1)%+(Е— 1)" = 0, Е = 1. (6.259) 
Some Euler numbers: 
Е=1 Е=-ь Е = 5, Е =— 61, E = 1385, 


Ey = —50251, E = 2702765 
E, = — 199360981, Ев = 19391512145, 
Ев = — 2404879675441, Ep = 370371188237525. 


All the Euler numbers are integers. This follows from the recurrence 
formulae for the Е. Two adjacent numbers with even subscripts 
have opposite signs. 

SYLVESTER’S THEOREM. If a, В, y,... are factors of the number 
n—m, the difference E,„— Em is divisible by those of the numbers 
2a+1,2B+1, 2y+1, ... that are prime. 
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The connection with Bernoulli numbers. Starting from the identity 


4x 2x 2xe-* 


we obtain 
co xn oo хі оо (—1)тхт+ї 
X В„2°(2% — 1) = =- X Ey Y ——— 
n=0 {=0 


> 
Leo т! 


from which it follows that 
` m(E— 18-2 


В, = т" . (6.260) 
Starting from the identity 
4x 4x 
wu 8) aes 
we get 
оо (4x)™ = Gx)! xl оо xk 
„Вп т! > П UNR = 2х RAD 
which gives 
h А 
Еру = ваз ав, (6.261) 


2k 


It follows from the last relationship that 


2k+1 3N2k+1 1 \28+1 
merre = (2+3) -(s«) ‚ (6262) 


which gives, on taking (6.215) and (6.233) into account, 


2k el 1 
ir; ба = Bay (+). (6.263) 


The sign of the Euler numbers. As follows from the discussion on 
page 329, B,,,,(x) has the sign of (—1)*~? in the interval (0, 1/2), 
so that Ej, has the sign of (—1)*. 

Some power expansions with coefficients expressible in terms of 
Euler numbers. Observing that sec t = sech it, we get 


ыы Е. л 
= —]y 22k por T 
sect 5 A 1) Qoi PRO [г] < Y (6.264) 
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On integrating the last series, we get 


«(14)- 


Integration of series (6.255) gives 


" Ec De za [+ Ins s. (6.265) 


CEFIN 


æ k+1 
arctan et = Z+ X І : (6.266) 


4*4 2 P TD 

The expressions for the sums of certain numerical series in terms of 

Euler numbers. On putting x — 1/4 in (6.244) and taking (6.263) 
into account, we get 


1 1 1 (= DhE nien 
r> 3m SRF ^ TRhii 0750 дао) — (6.267) 
For 'example, | 
= Sy) Ј 
2 E "nal -y= 5P PX 1) (2т+Г? 32° (6.268) 


Integral forms of Euler numbers. It follows from (6.246) and (6.263) 
that 


n = (—1)"2Ф®+1 | f? sech (п (п = 0, 1, 2,...). (6.269) 
0 


2°. The Euler polynomials are given by 


Eus ( -2+2) с bi ( ; ) 2-^E, 6 " i ‚ (6.270) 


where E, are Euler numbers. 
The generating function for the Euler polynomials is 2e*(e'+ 1)-1. 
Its expansion as a power series, convergent for |t] < л, is 


m № 
2e*t(el + 1)-1 = > BO т: (6.271) 
The difference equation 


Дх-к1)+Дх) = 2x (6.272) 


is satisfied by the Euler polynomial E,(x). This follows from the 


relationship 
2е(=+1Ще! + 1)71 4 2&2 (et - 1)71 = ext, 
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Recurrence formulae. On differentiating (6.270), we get 
Ex) = nE, (x) 
from which it follows that 


H x 
ej (X) = E, Ө +п | Е„-\(хХ) dx. 
1/2 
Since E,(1/2) = 27™E, (see (6.270), we have 


Ех) = 2-"E, +n | E, 49 dx. 
1/2 


In view of the relationship 


335 


(6.273) 


(6.274) 


(6.275) 


до "оз т оо m 
deere = Y EQ)T Y = Y Eee) 
т=0 Г. то mi n=0 п! 


we have the recurrence formula 
e n 
E,(x+1) = У (7) Ex) 
reĝ 
or, on taking (6.272) into account, 
д [п 
LEG) = °= Ў ( сэ. 
то \ Г 


Some Euler polynomials: 


Ех) = 1. 
E(x) = х-5. 
Ех) = х?—х. 


iod 
Ех) = x—* +=. 


E,(x) = x*-—2x3 +x. 
NEU ee ae 
Ex) = %—-ух4+-у4—-. 


E,(x) = x8— 3х5 +523 — 3x. 
7 35 21 17 
Sg НЫША. ПЕР Жазын E 
Ех) = х 5 х1 х Tt. 
E(x) = x8 — 4x? + 14x5 — 2833 — 17x. 


(6.276) 


(6.277) 


(6.278) 
(6.279) 
(6.280) 
(6.281) 
(6.282) 
(6.283) 
(6.284) 
(6.285) 


(6.286) 
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The connection between Euler and Bernoulli polynomials, Starting 
from the relationship 


xt t -1 t xt 
Zf He ete = 
te? (4 - = te ? (gl — 1)-1— te * (e 1)-1, 


we get 


нн) (5)]- 


= oan Lo 2B, (2) . (6.287) 


Trigonometric expansions of Euler polynomials. On using the 
trigonometric expansions of Bernoulli polynomials in the interval 
O- х= 1, we get 


Eg) = (7 DP 4QO LY [n+ я-а sin Qu Dax 
(п = 1, 2, 3,...). (6288) 


Egi) =(— D 4Qk +1)! Хол + 1)л]- 28-2 cos (2n + Dax 
(п = 0, 1, 2, 3,...). (6.289) 


A multiplication theorem: 


m-i 
E,(mx) = m^ Y (- DE, (+), m=2k+1. (6.290) 
© 


mri 
E,(mx) = —2m"(n1) Y (— ут, (5 tx) т=2К. (6.291) 
т=0 
Integral forms of Euler polynomials may be obtained in the same 
way as those of Bernoulli polynomials: 


* 121 sin xx cosh xt 
ү рү 
Ex) = (0% ү cosh 27t — cos 2лх 2 (6.292) 


(O<x<1; n=0, 1, 2,...), 
122+1 cos xx sinh лї 


Enix) = (— paa f ORA = cos Ge, dt | (6.293) 


(О = х= 1; п=0,1,2,...). 
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§ 3. Elementary piecewise linear functions and delta-shaped 
functions 


1. Piecewise linear fanctions 


1°. The absolute value of x (written as |х|) is: 


МЕ. х = 0, 


0 х= 0, (6.294) 
x, х > 0. 
ху! s |х|+]у], Ix—»i = 151-1211. (6.295) 


The binomial expansion of |x| = J1— — х9), for |x| < 1, is 


1-x Qk—-3)! 


к= ер =. GE! 


(1—33*. (6.296) 


The approximation, for |x| = 1, by Bernshtein polynomials (see 
§ 1, sec. 2) of even degree is 


To ]—x?N^ 2 2n 1+х\* /1—х\Ё 
ai= tan (VS (CS) (3 
(6.297) 
The approximation by Fejer polynomials, for |x| = л, is 
EE. "E л 8%) n—k cos Qk — Dx 
[х] = ш an- = lim, 0 2n-1 (Qk—DP | 
(6.298) 


The expansion in Legendre polynomials P,(x) (see Chapter IV, 
$4, sec. 5), for |x| = 1, is 


ix] = Y, аР), 
n=0 


1 5 2k—3)!! 
аһу = 0, a = 7° @ = аз = (— 1)Ё+1 (41) 5297. 
(6.299) 
Fourier's expansion, for |x| = л, is 
_ %_ 4 @ cos(2k+1)x 
= 4 x. Qk--1y ' (6:300) 
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The integral form is 


2 [= 1—cos xt 
|x| = al S dt. (6.301) 

Polygonal functions; the approximation of continuous functions by 
polygonal functions. Let A(x;, у) (i = 0, 1, 2, ..., n, ...) be given 
points. The function 


fo = Yet ex Ex xl 


+5 pi (аа kc х) 1х х), (6.302) 


where А; = (уу И) (а), is described as polygonal; its 
graph is the polygon 4414... Ap It must be borne in mind that 
ge enean [0 fo x sa, 
x-a for xa. 

If f(x) is a continuous function in (a, b] , there corresponds to 
the subdivision a = xo < X, < хо <... < x, = b a polygona 
function whose graph is a polygon inscribed in the graph of f(x), 
with vertices at the points (xy yj), y; = Лх) (i = 0, 1, 2, ..., n). 

Every continuous function is the uniform limit of polygonal 
functions. 

On taking expansions (6.296)-(6.301) into account, we find that 
any polygonal function, defined in an arbitrary segment [a, b], is 
the limit of a polynomial sequence, uniformly convergent in [a, 5] 
(Weierstrass's theorem). 

Schauder's basis. The polygonal function 


Fap(x) = (1х—а[- 12х—а—81+1х-В1) = < В, (6.303) 


1 
B-« 
is equal to zero outside the interval (о, В); in (x, В) its graph is an 
isosceles triangle of height 1: 

Fup(x) = 0, х <@,‚,Х > В; 
«+Ê, 

ERE 

«+в 

>. 


F. p(x) = 2x— 2a, x < (6.304) 


Fap(x) = —2x+2B, x > 
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Let y = f(x) be a continuous function in (а, В). We introduce the 


numbers 


a+B 


ак? = (25 (6.305) 


J- FOA 


Schauder’s basis is defined as the sequence of functions in [0, 1]: 
1, x, Рб), Е, 10), Fy ‚60 Е, 109, 
"2 g "4 


(х), ..., Ка ins. 


oh’ “2h 


F 
T 


@=0,1,...,2ҖЖ—1; k=0, 1, aed, 


+ (6.306) 


Any function f(x), continuous in the interval [0, 1], can be expanded 
(uniquely) as the series 


Дх) = КО) D) -AO + 
T ў v da ii ОЕ 


Кто To тоу зғ 


а (6.307) 


4109. 
2k 


The partial sum of the last series 
Sax) = 0) +101) — (01 x + 
+ Ў Yd: n) Fi 


i 
k=O i=0 gE “QF or’ 


азл (х) (6.308) 
28 


has a graph consisting of а step-function, inscribed in the curve 
y = f(x), with vertices at the points (1/2", f(i[2^)) (i = 0, 1, ..., 2). 
The derivatives of the functions of Schauder's basis form a system of 
Haar functions (see (4.24) and (4.25)). 
2°. Sign x (signature x) is 


—1 for x-«90, 
sign x = 0 for х= 0, (6.309) 
1 fo x0 
or 
x 
sign x — | [epus moo (6.310) 
| 0 for x=0 
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ог 


sign х = lim 2 arc tan nx. (6.311) 


n= со 


Fourier’s expansion is 
| _ 4 & sin Qk Dx 
sign x = PRA = |x| = х. (6.312) 
The expansion in Hermitian polynomials (see Chapter ТУ, § 4, 
sec. 10) is 


(n —2)! 2n 
sign x — fs и База A Ana). (6.313) 
The integral form is 
qe 
sign x = lim eoe ыш dt. (6.314) 
T-—997 jo 


The sequence of signs of sine (Rademacher functions) is 
p(t) = sign (sin 2kzt), (6.315) 
r(t) = sign (sin 2kzt). (6.316) 


3°, The integral part x (written as [x], entière x, E(x)). If x = n+r, 
n is an integer, OS r< 1, then [x] = n. 
The following relationships hold: 


[x+y] = bd Di: (6.317) 


H = Н , п is an integer; (6.318) 
Bebe = = [nx]. — (6319) 


If p and g are mutually prime integers, we have 


Се [er] EE om 
АТАЕВ 


= +S t+... Spt... +5 (6.321) 


where s, is the number of factors of К, 
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Fourier’s expansion is 


NES 1-1 Ў SRM (x #0, £1, £2, +3, ...). (6.322) 


T n=1 
The function {x} = x— [x] is called the fractional part of x. It isa 
periodic function with period equal to unity. 
4°, The distance to the nearest integer {denoted by (x)] is 


(х) = min (x- [x], 1 -[x]- x) . (6.323) 
The function (x) is periodic with period equal to unity. 


The Fourier expansion is 


$ cos 2л(п + 1)х (6.324) 


Е 
47а Qnil C 


5°. The jump function 1(x) (Heaviside's unit function) is 


0 for х<0. 
1(х) = i 6.325 
e | 1 for x =O. ( ) 


The rectangular pulse is 


0 for x<a, x> 8, 


х—-бў= (х—) = | В >а. (6326) 


I for «sx sf, 


If f(x) is a continuous function in (a, 5], the sequence of functions 
n 
ЛО) = 2 (х)1(х— х) — 1(х xr] (6.327) 


tends uniformly to f(x) on indefinite subdivision of [a, b] by the 
points x,: 
а= XQ XQ х =... XQ = D. 


6°. The representation of certain piecewise linear functions with 
the aid of integrals and series: 


2 (sin £a e I for O0O<x <a, 6.328 
ET Е cos Bx a= | for хе а. (6.328) 


E ж TIT 


0 for x >a, 


(6.329) 
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+1 for rege 


2 = 2а . nx плх 2 
wl c 1 
n=l —1 for уа=х=яа, 
2 = E 
= Y (yt — sin — =x, OSxsa 
а n=l 
28 a плх х 
— ¥ — sin — = 1--, Osxsa 
а ли a a 


x № TEFEN 


1 
a—x for 3;4758x* а. 


cos Е u — cos Č 
> 6 0 ut 
2 |” Sg ep 
1 for р = 1-6, 
= 0-0) for 1-0 Ша 
0 for || 21. 
= sin? > 1-11 for и|ж#1 
2 cos tx dx = pu. 
BE 0 for |t| z I. 
1 for 03 x <a, 
ml SID 02 cos zx dz = l for x =a, 
mjo 2 2 
0 for x >a. 


= | — dx = 0 for 


Tj. * 1 for 


Я —1 for x = 0, 

2 [sin ax 
® = 0, 
а > 0. 


(6.330) 


(6.331) 


(6.332) 


(6.333) 


(6.334) 


(6.335) 


(6.336) 


(6.337) 
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for x = ath, 


0 for x < a—h, 

i for x 2 a—h, 
. 2 (Т sint 
Jum =| —, @08 (x-atdt—4 | for a—h = х <ath, 
эм оо 0 

1 

2 

0 


fo x > a4. | 
(6.338) 


2. The д (delta)-function 


А sequence of functions {u,(x)} is said to be weakly convergent 
in the interval (а, b) if, given any continuous function f(x), the fol- 
lowing limit exists: 


v= oo 


lim | /Оди„х)ах. (6.339) 


If the sequence {u, (x)} satisfies the conditions: 
I. For any М > 0, we have for |а| = M, |b| = M: 


b 
| u,(x) dx 


a 


< КМ); (6.340) 


II. Given fixed a and b, |а| > 0, Pl > 0, 


lim ide 0 for a«b«0 or 0—-a-b, (6.341) 
m 1 for а= 0 = Б. 


then the limit (6.339) exists, does пої depend оп the choice of sequence 
{и,(х)} and is equal to f(0). The limiting element of the (weakly) 
convergent sequence {и,(х)} is referred to here as a delta function: 
6(x). Thus 


b 
| Josx) ах = ДО). (6.342) 
а 
Sequences satisfying conditions I and II are described as delta- 
shaped. 
Examples of delta-shaped sequences are: 


1 


W(X) = xA 6 > 0; u(x) > 60): (6.343) 
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xt 

Е d ma) d (6344) 
2 nt 

u(x) = lmw ‚ O<v<0, u(x) d(x). (6.345) 


The elementary properties of the delta function are: 


ó(— x) = (2); (6.346) 
Лх) (х х) = Кох х); (6.347) 
хб(х) = 0; (6.348) 
25 0х—х,) = (x — хь) 
= Тәр бш, 699 
where x, are the simple roots of the equation ф(х) = 0; 
_ 29. 
б(ах = Tal? (6.350) 
_ &(х—-а)+ф(х+а). 
9(х°— а?) = PTUS (6.351) 
|x Jb?) = d(x). (6.352) 


The convergence of the series expansions and the integrals quoted 
below is understood as weak convergence. 
The Fourier expansion, |x| = 1, is: 


101 =») 


хх) = ts ааа (6.353) 
n=l 


21 1 

The expansion in Bessel functions (see § 4, sec. 6), OS r = R, is: 
р’ r 
(а, =)» (s = 
= 2\/т' R R 

(ив = E RH AMD у, 6.354 

7-9 hU 745) а 


The expansion іп Legendre polynomials, |x| = 1, is: 


доу + 1 р (х)Р, (х). (6.355) 
n=0 
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The expansion in Hermite polynomials is: 


= х" 
х — х) У ыы з A, (x)H,(x). (6.356) 
n=o 4/72"! 
Integral forms. Fourier’s integral is: 
0(х'— х) = = |. cos k(x’ — x) dk. (6.357) 


The Fourier—Bessel integral is: 


Ме) = ИР [ 7 quer) fer!) dk, 
0 


e (6.358) 
èr’) = rf kJ(Kr^) dk. 
0 
The involution is: 
n &(t— y(t ий = би — pa). (6.359) 
The derivatives of the delta function are given by: 
8) = 1709; (6.360) 
ў Ах) (х В dx = —/'(А); (6.361) 
[n f G8 (x — вах = (— EMA), (6.362) 


Series of delta functions are: 


cos X --COS 2x -- ... +созих+... = 
= -у+п x (х 2ли); (6.363) 
sin x+2 sin 2x+...+nsinmx+...= 
2 -a È 00х21); (6.364) 
COS X +4cos2x+... +7 cosmx+...= 


= лу 8"(x—2an), (6365) 
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§ 4. Elementary special functions 


1. Elliptic integrals 
DEFINITION. Any integral of the form 


х R(x) 


——— dx, 
o N P(x) 


where R (x) is a rational function of x, and P(x) is a polynomial of 

the third or fourth degree, can be transformed to a sum of integrals, 

reducible to elementary functions, and to integrals known as elliptic 

integrals in Legendre's normal form. The latter include the following: 
the elliptic integral of the first kind, 


in 9 dx 
ЕК, Фф) = ===; 6.366 
(k, 9) f TNT (6.366) 
the elliptic integral of the second kind, 
sin o [REN 
E(k, ф) = | i-e dx; (6.367) 
0 J1-x 
the elliptic integral of the third kind, 
sin Ф dx 
Dk, А, y = —————À ыы (636$ 
р | Буар C9 


The notations: Еф, К), Еф, К) апа Пф, А, К) are sometimes 
employed. 7 

The parameter К is called the modulus of the integral, and A the 
parameter of the integral of the third kind, k? < 1. 

The number k’ = 1—k? is called the complementary modulus. 

The quantity х is often employed, instead of К, where К = sin a. 

If we put x = sin y, the elliptic integrals reduce to the normal 
trigonometric form: 


Ф dy е dy 
ЕК, = ———— = кеу 6.369 
k, Ф) F ELT а (6.369) 


0 
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Ф Ф 
Е(К,ф) = | 1—R sin? y dy = | Ay dy, (6.370) 
0 0 
0 ERE. ЕЕК" dp 
o (1+4 sint y) /1—X3sin?y о (Аир 


(6.371) 
where Ap = V1—k? sin? y. 
The following notation is used for a commonly encountered 
combination of these integrals: 


ГК, 4, Ф) 


_ Fk, p)—E(k, $) (sin? y = 
атт m 
sin 9 
AN I NECS 
о Мх) 1 9) 
Representations as series: 
i 1.3 1.3.5 
ЕК, 9) = Aot Ak b АЕ 4+ .... (6.373) 
EXT 1 a 1. i 1.3 é 
Elk, p) = dog Akg Ak agg ANS 
1.3.5 
-gy 44-0 6319 
where 
Ae | шеи (n=0,1,2,..). (6375) 
0 


The coefficients 4, сап be evaluated successively in accordance 
with the formulae: 


2n—1 


Ay = Ф, An = 2л 


Ana D cosgsin?t-ig, (6.376) 
If g is close to 7/2, the following formulae are convenient: 


ЕК, Ф) = rr ir. (К, Ф). (6.377) 


348 MATHEMATICAL ANALYSIS 
E(k, 9) = =(ь 5) —E(k, фу) + А віп ріп фі, (6.378) 


9, being given by the equation 


cos p 
JI— sin? g 
If the upper limit of the integrals is equal to z/2 (p = 7/2), the 


complete elliptic integrals are obtained. 
The complete elliptic integral of the first kind is 


LIP ар 
28 ies NE x TES TUR 


The complete elliptic integral of the second kind is 


Ух 
К A р Я 
Е = (к 5)- ile pdp = | “л dx. (6381) 


sing, = (6.379) 


Неге, 
К-Е 
D= p(x А )= “м (6.382) 


Representations as series and products: 


(Qn— D! 


K= e a m (6.383) 


E= HE у с 2: (6.384) 


nei 
- 2n- DU 
Em "au | den (6389 
л > 1-1 
= = 1+k,); where k, = а К = К. 
2 П‹ л) Сов 0 


(6.386) 
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20 a 
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ИЕШЕ 
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Fig. 5. Elliptic Ll 
integral of the first : | " | - 
kind F(k, 9); Lupe e ea 
k=sina=const. 00 
? 0 20 80 40 50 бо 70 80 30° 
20 


Ею. 6. Elliptic 
integral of the se- 
cond kind E(k, ф); 
k -sin о const. 


20 
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20 
Же» 
15 10°; 
60 E 
10 0 
шул 
0 
05 Б 
70 
00 o 1 
0 10 20 30 40 50 60 70 80 90° 


— X 


Fic. 7. Elliptic integral of the first kind F(k, p); p = const, k==sin a. 


20; /0 20 30 40 50 60 70 80 90° 


— (Y 


Fic. 8. Elliptic integral of the second kind E(k, p); p = const, k—sin «. 
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The following formulae are employed when К is close to 1: 


к= me( 3f nen (eni 2) 


13.5 V 2 Na 


12.32.4 2 2 пух 
727426 Ет mu us k T... А (6.388) 
Here, т = ln 4/k'. 
Some integrals аге: 
Как 1 kD-K 
Edk k?K-2E 
[5 РЕ (6.390) 
f K kdk = E—Kk"?K = (К – D); (6.391) 
2 12 
f Ek dk = LUE g Pg. (6.392) 


Graphs of the elliptic integrals are shown in Fig. 5, 6, 7 and 8. 


2. Integral functions 


DEFINITION, The following definite integrals are known as integral 
functions: 
The integral exponential function 


х et 
Bi(x) = | fd 6-0. (6.393) 
The integral logarithm 
| z dt 
i= 8E о<х—<1). (6.394) 


o Int 
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The integral sine 
si(x) = zb = (90 = 5). (6.395) 


The integral cosine 


cos 1 


сі (х) = erm —C— dt (x < 0). (6.396) 
In addition, the following notations are used: 
Si) = 5+8) = F EE (с) = ij (6.397) 


Ci (x) = ci (x). (6.398) 
When x > 1, the function (х) is defined as 


tim ( (70 @ 
col Jo Int 14, Int |" 


When x > 0, the function Ei(x) takes complex values; the real 
part of Ei(x) is denoted by Ei(x). The bar above the Ei is occasionally 
omitted. 

Relationships between the integral functions are 


Ei(inx = (ху) (x < 1); (6.399) 
Eidnx)=li(x) (х > 1); (6.400) 

li (e) = Еі (х) (х = 0); (6.401) 

Ei (ix) = ci (x) +i si (х); (6.402) 

Ei (x + i0) = Ei () T лі; (6.403) 
Si(—x) = —Si(x); (6.404) 
si(-x)2 —si(x) —л; (6.405) 
Ci(-x)2Ci()zmm (x>0); (6.406) 


in? 15 2 
ару. [ s dt. (6.407) 
x Ü t 
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Representations as series are: 
ЕСА У eO; 
н k=l kk! d 


и = xh 
Е (x) = С+Шх+ LT x = 0); 
(x) PE (x > 0) 


lio) = Cl (-lnx) Y, ae (0 = х = 1); 
li (х) = Съ xe m (x > D; 
“ф) = - $+ È Cn CN 

ci(x) = Che Ў CD a 


Here, С = 0:57721 56649... 
Approximate formulae (for small values of x) are: 


li(x) = — ; 
in— 
Si (x) ~ x; 
T 
si(x) = х-5; 


Ci (x) = Ei(x) = БЇ(—х) = C 4-In x. 


Asymptotic formulae (for large values of x) are: 


еы са. б 
х хе) 


=. 3t 5! 
+ 
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(6.408) 


(6.409) 


(6.410) 


(6.411) 


(6.412) 


(6.413) 


is Euler’s constant (see р. 310), 


(6.414) 
(6.415) 
(6.416) 


(6.417) 


(6.418) 


(6.419) 
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Я sin x 21 4! 
Cl (x) = ( -E ==” )- 
_ osx (11 3! 5 _ sinx 
x x Xx ВЕ 


Ei (x) БЫ =; 


-x 
БЇ(—х) = —. 


Some numerical values are: 
Ei(—1) = — 021938 3934... . 


Ei (1) = 189511 7816... . 
li (1-45136 92346...) = 0. 


Some limits are: 


lim si(x) = —z; 
x—> оо 

lim ci(x) = + ль 
х = 


lim [xsi] = 0 (e < 1); 
х + е 


lim [x ci()] 2 0 (e<l); 
х- + со 
lim e-* Ei(x) = 0; 
и +o 
lim хет Ei (x) = 1. 
хз +00 


Some integrals are: 
Не x l—e~m 
| Ei (—mt) dt = x Ei (—mx)— n 


0 


ee andre in Tak 
Я р gp 


(6.421) 


(6.422) 


(6.423) 
(6.424) 
(6.425) 


(6.426) 
(6.427) 
(6.428) 


(6.429) 


(6.430) 


(6.431) 


(6.432) 


(6.433) 
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55 


"ELSE 


— Х 
FiG. 9. Integral functions: the sine Si(x), cosine Ci(x), logarithm li (x) and expo- 


nential functions Ei(—x) and Ei(x). 


Ею. 10. The integral exponential function Ei) and the integral logarithm li(x). 
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у 
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| 
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— х 


Fic. 11. The integral exponential function —Ei(x). 


| нео ака Pa (6.434) 
" q q 


| 7 cos t Ci (f) dt= | sintsi(dt= - 2 (6439) 
0 0 


са = | "гуш = 2, (6.436) 
0 0 d 2 
| сі) ві (0 = —in2; (6.437) 
0 
$ м x for « > В, 
| ci (at) ci (Br) = | si (at) si (Bt) dt = | ^ (6.438) 
2 $ zi for « < В. 


The graphs of the integral functions are shown in Fig. 9, 10 and 11, 
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3. The error function 


DEFINITION. The error function is defined as the function 
efx = ml. етай [erf (=) = 1] (6.439) 
El 


It is often defined as 


oo JA ета (6.440) 
7 jo 


or (by S. N. Bernshtein) as 


Фу) = Те ee *_). (6441) 
Ут 2 2 023 C 
The following notations are also encountered: 
2 oo 
erfex = 1—ех= —=| e" dt, (6.442) 
a 
L(x) = f e`? dt = ME erfc x. (6.443) 
Е А 
Relationships between the functions erf x and ф(х) аге: 
Ф(х) = ert | -> А (6.444 
Ба) one 
erf x = Ф(х 2). (6.445) 
The derivatives of the error function are: 
d 2 
——(erf x) = —— 2; 6.446 
619 = о= (6.446) 
d 2 -= 
EN zm odes 
E Ф(х) E e 3. (6.447) 
The integral of the error function is: 
егїхах = xef x+- e-* t (6.448) 
JR 
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Other integral forms are: 


mrs E (6.449) 
erf x = — —= at; . 
Jn Jo VE 
aes | ет dt; (6.450) 
Vn Jo 
of (SHE as di (6451) 
€ X) = — — . x 
(Мах) x o Vat 
@ТТТТТТТТ ШЕЕ == 
oof TTT 
" = 
08 
07 
os 
6 | SE ES 
as CT 
04 
gs RN 
ШУ) MN 
021-70 


Fic. 12. The error function erf x = va) | e~t dt. 


The representation as a series is 
x?-1i p 2ky2k+1 
DED ут жок+ 


(6.452) 


efx = 2 Я -pm 


тка 


Asymptotic formulae аге: 


er (/%) = 1- e-s Š (-1) +в» (645% 


i 
k+— 
+2 
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г(» +2) 


1 
"n 
2 


where 


, х= хе and g?-« лё; (6.454) 
|x| cos 7 


-xi 


e 1 1.3 1.3.5 
erfc x = c з OS о + us | (6.455) 


The graph of the function erf x is shown is Fig. 12, which also 
gives the graphs of tanh x and 1— e* for comparison. 


4. Fresnel integrals 


DEFINITION. The following functions are called Fresnel integrals: 
the Fresnel sine integral, 


5(х) = EF sin t? dt [sc ә) = 1], (6.456) 


the Fresnel cosine integral, 


С(х) = ET cos t? dt [e oo) = al (6.457) 


The following definitions of the Fresnel integrals are also 
occasionally encountered: 


x 
Stax) =| sinžed=s( |Zx], (6.458) 
ARD 2 
x 
C*(x) -| cos Z tdt = e( Fa). (6.459) 
ОАО 2 
Other integral forms are: 
1 f*tsint 
569 = xl nio (6.460) 
„2л о t 


соз = —— [| “соз E (6.461) 
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РА T s 
S(xy) = Ta sin (7t?) dt; (6.462) 
С(ху) = == " cos (y*1?) dt. (6.463) 


zl 


The representations as series are: 


+3 
$0) = BEC» SUN BE (6.464) 


ak+1 
C(x) = (25 yd D ВЕЕТ ID (6.465) 


The asymptotic formulae are: 


5(х) = j- = cos x? +0 (=) (х +); (6.466) 
C(x) = 5+ 5 sin 2+0 (=) (x +). (6.467) 


The connections between the Fresnel integrals, Bessel functions 
and the error function are: 


SQ) = = AE — (t) dt; (6.468) 


C(x) = = т| 7% 504; (6.469) 


Сс) +150) = б erf ( я)” Er edt; (6.470) 


С@)—15() = я eif (2/7) = Ef ее, (647) 


Some limits are: 


lim 50) = lim CQ) = (6.472) 


х—-> + ое X— + оо 


lim [59-5 | = lim ee =0 (0= 1). 
X—> + 00 x> +00 


(6.473) 
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Fic. 13. The Fresnel integrals S(x) and C(x), x?=z, 
Some integrals are: 

р ap?) — 

| Sead = р5(хр) eh. (6.474) 
о х 4/27 
р i 2,2 

| Clax) dx = pC(ap) - EE., 
0 х 


2 (6.475) 
=r] | 2 4/2 cos i sin га 
n Es sw] sin 2px dx = — = 3 (p > 0); 
(6.476) 
ory 2/2 sin x sin = 
f [z-z] sin 2px dx = — элтр (р > 0). 
(6.477) 


The graphs of the Fresnel integrals are shown in Fig. 13 
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5. Gamma and beta functions of Euler 


The so-called Euler B- and I -functions are important non-elementary 
functions. They are defined by improper integrals dependent on a 
parameter; they have been carefully studied, and fairly detailed tables 
have been compiled for them. 

The fundamental properties of the functions are described below. 
All the parameters appearing in the formulae are real. The operations 
employed, of differentiation, integration, change of the order of 
integrations, summation, etc., are valid, inasmuch as the integrals 
are absolutely and uniformly convergent for the values of the 
parameters considered. 

1°. Definitions, functional equations and elementary properties 
of the Г (gamma)-function of Euler. For x > 0, Eulers gamma 
function is defined by the integral 


Г) = | 7 ха-ле-я dx, (6.478) 

Change of the variables leads о the formulae: 
Г@) = f (= 32 dx; (6.479) 
Ге) = f T erea dx, (6.480) 


Integration by parts of (6.478) gives 
Ге) = (&—1) r(e- 1) (6.481) 

and in general, for integral n and œ > 0, we have 
Га) = (хХ—1)(®—2)...(ж®—п-+ 1) Га-в--1. (6.482) 

On putting « = п (integer ) in (6.482), we get 
re) = (@—1)! _ (6.483) 
Continuation of the gamma function into the negative semi-axis 
is accomplished in accordance with the formula 

Г(о) 


&—1 


Ге-1) = (6.484) 


Го) = Fer) (6.485) 
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first into the interval ( — 1, 0), then into (—2, — 1), so that, for —n< 
<х< —(n—1), 


B Г(х+п) 
Го) = х(х+1)...(х-+л—1)? (6.486) 
whence, for 0 < « = 1, 
I(x—n)- (—1)" To (6.487) 


(1—«)2—2)...(n—a)' 


The function Г(х4-1) is often denoted by the symbol Л (х). 
The gamma function is discontinuous for all integral negative 
values of the argument, since it follows from (6.485) that 


lim |x-A(x - D| = e. (6.488) 
prd 


It follows from (6.478) that, at points where the gamma function 
is continuous, its derivatives may be evaluated from the formulae 


Га) = Г x271e-* |n x dx, 
А (6.489) 
Гоа) = | x*71e7? (In x)*dx. 
о 


REMARK. An equation of the form 
Ех, у(х), у'(х),... yx) = 0 


where Е is a polynomial in its arguments х, у(х), y’(x), ..., y (x), is 
called an algebraic differential equation of the nth order. A function 
у(х) is described as hypertranscendental if it is not a solution of any 
algebraic differential equation with polynomial coefficients. The 
function T(x) is hypertranscendental. 

For instance, y(x) = sin x is a solution of the algebraic equation 
y?y? = 1, so that it is not a hypertrascendental function. 

An elementary asymptotic formula. It follows from the inequality 
with 0 = х < 1) 


n*Itn)— e-np*tn-i- Г(а- п) = 


= | EN = ne-il(n--.1)-e-^49*n-1 (6.490) 
о n 
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that 
as ш 1, (6.491) 


The representation of the gamma function as a series is mentioned 
in Chapter Ш, § 3. sec. 16. 

Expressions for I(«) and Г- Ҳо) as infinite products. If we use 
(6.491) and replace J(x--r) in accordance with (6.482), we arrive 
at the Euler-Gauss formula 


n! 


To)» uM TIME Det We» 
Or 
Ге) = Шт па iea (6.493) 
n-— = TI ( + ») 
»=0 


We сап obtain from these last formulae, on making use of the 
transformation 


п 

2+ 
Ц = (1+5) = 

nin? толуу » 

y а 
-annt Ton а 
=e vai” а | ((: 2322 
9-1 ? 


the Weierstrass formula 
1 Sed EX o 
— = Pg = оба m v (6.494) 
m ы (С +5), ) 
where С is the Euler-Mascheroni constant (6.56). 
The formula for the complement 


ror — a) = (6.495) 


sin лж 


follows from (6.493) and the formula 


sin za } ш о? 


n-> оо 9-1 
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In particular, it follows from (6.495) that 


r(4) TEN d (6.496) 


Since we have, from the formula for the complement, 


1 2 п-1 үр ani 
ВОО п | no AU 2 . n=l ' 
sin — sin — ...sin л 
п п п 


| (6.497) 
we obtain, in view of the relationship 
n—i . kn n 
П sin pu = 2-1 


the Euler product: 


п 


1 2 п-1\ (x)? 
rG) z )- Se (6.498) 


The multiplication formula 


nd v к= ~ha tt 
П Г (. +) = (2л)? k 2 l'(kx), ж> 0, К is an integerz 1, 
sao, (6.499) 


follows from (6.493). When k = 2, we get the (Legendre) doubling 
formula 
1 
Гог (. +1) = x2 7*3 Год. (6.500) 


The logarithm of the gamma function. On taking logarithms of (6.493) 
and passing to the integrals, we arrive at the integral form of the 
logarithm of the gamma function: 


E n n 
In «TP (a) -E(v с = 


eo 0 ene — еп+а)х ent — оп+1)х 
» а Е |в 
n=l x x 


—оо 


о ү—ев=—щ({—е®) 
| x(1— e?) 


ll 


ех dx, 


in Ге) = Г [= -e-ve E. (6.501) 
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Other integral forms are: 


pe _. 024 2-*-(0 4-27 
In Го) -f [e-n та] т. 02-0, (6.502) 


nro = f| re ЈЕ > 0. (6.503) 
р и * 


Raabe's formula. On taking logarithms of the Euler product 
(6.498), we get 


and if 


we have 
1 
| TO ee lk um (6.504) 
0 


The Raabe integral is obtained by differentiation with respect 
to the parameter: 


1 
J- | In Га-х) dx = a (о 1+1 J2m). (6.505) 
0 


Another expression for the Raabe integral is obtained by inte- 
gration of (6.501): 


o dx[ et ех 1 
=} ее (а) е]. вз 
It follows from (6.501), (6.506) that 


ш Г@)—/+ ! —- == |. fde dx, (6.507) 


1 1 1,1 
fe) xri) 


where 
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On introducing the Binet function 
0 
юш) = | Лех dx, (6.508) 


we get an asymptotic expression for the logarithm of the gamma- 
function: 


In Гә) = In ym (s -i) Ina —«4-o(x). (6.509) 


It also follows from (6.501) and (6.506) that 


yar (« +7) = | 9 деха dx, (6.510) 


where 


тө- (1-25). 


From this we obtain an asymptotic formula for Г (2) 


la r (« +1) =a(ne—1) + 1а „л юпа), (6.511) 
where 


o(a) = f F(x)ea* dx. (6.512) 


The following relationship holds: 
w(x) = o(x)— 022); (6.513) 


it is obtained by taking logarithms of the doubling formula (6.500) 
and substituting for In Г(ж) and In Г(2х) in accordance with (6.509) 


and for In Г (==>) in accordance with (6.511). 
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The following formulae are due to Schaar: 


wl) = "foyer dx = |; SS = 
= 2 | as In (1— e2), (6.514) 
оа) = z[ are in aur NE In (i-em) 
= + | i In (1 4- e). (6.515) 


The Stirling and Gauss asymptotic formulae. By using (6.179) and 
(6.508), we can obtain the Stirling series for the Binet function: 


_ B i В, 1 
т 
Ban- 1 
ioe оби ams TR (6.516) 
where 
R = 0-2” : 0<0 < 1 6.517 
т ПА! (6517) 
When п = 1, 
IDE _ 8 


and Stirling’s formula follows from (6.509): 
inte) = в + («-1 | шов, (6518) 
2 12a’ 


eee 
Го) = fina’ te m. (6.519) 


Stirling’s formula is again obtamed when « is equal to an integer т: 


m 8 
m! = „лт (2) glam . (6.520) 
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An asymptotic formula for w(x) follows from (6.513) and (6.516): 
_ B, Puto 1\1 
ex) = a (1 Sale ae -=)=+ 


в, 15 


In particular, 
0 (<) = 8 EIU Rc - S 0=0 = 1. (6.522) 


Gauss’s formula follows from (6.522): 


In r(s +4) = «(шх—1)+1п Vis. (6.523) 


1 y 
When n is an integer and х = nts, a formula is obtained fora 


factorial that gives a better approximation than Stirling’s formula: 


6 
е n+, (6.524) 


The power expansion of the logarithm of a атта function. It 
follows from (6.481) and (6.493) that 


log Г1 +=) = 


a dx а I(x) Е afl 1 
Е (Sef re. | |- c+ (5- ==) | = 


= — сай Bb tbat $a (6.525) 
where 
1 1 
Sp=ltgpt-.- tort: 
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The trigonometric expansion of the logarithm of the gamma 
function ( Kummer's series). If, when x€ (0, 1), 


ш Г@) = A У (а, cos Inna +b, sin 2плх), (6.526) 
n=1 
where 
1 
= af 1а Г (х) cos 2илх dx (n = 0, 1, 2,...), 
0 


(6.527) 
b, = 2 алд sin mds (n = 1, 2, 3, ...), 
we have by the formula for the complement: 
In F(«)+In Z'(1—«) = а + »x 2a, cos 2nma = 
= In2a— Insinzx = In2z4. Y eamm (6.528) 
whence = 
l^ = № /2л, a, = x 0-52. (6.529) 


We have from (6.502) and (6.64): 


IE 
us «d cas ULL de = 
1 m BEAT 
ев Е s u -=l (79 M 2c 


pur (2-“— e-anmuy @ = = = (С+1а2лл). (6.530) 


Further expansions of the logarithm of the gamma function are 


InT(l+a) = 5 lt — Cx -2 a — bab — wee, (6.531) 
nr ee ee y 


+(1—С)х—(%— үе ‚... (6.532) 
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The logarithmic derivatives of the gamma function (the psi or 
digamma function). By definition, 


va) = То = Zale; 
oe e+) d EUNT (6.533) 
Юта a er 
so that 
Ya) = v). 
The function (a) satisfies the functional equations: 
pl +о) – ya) = 2. (6.534) 
бо) (1 о) = —лїапла. (6.535) 
у= -atanma (6.536) 
y 42)-—y(1—«) = — a tana +. (6.537) 
" (5+ =)-з (2- x) анаа (6.538) 
yma) = mS y (s ex) Жш (6.539) 
тз 


It follows from (6.492) that 


Г’ 1 = 
we) = уз eet E) € 


we have 


ye) = -C+ > ( : yu) (6.541) 
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It follows from (6.541) that 


20 1 1 
Wa = -С+У (f #di— f na) = 
v=o \ Jo 0° 
1- fi 


= крз dt. (6.542) 
о —t 


On carrying out the change of variable 1+y = 171, and taking 
account of (6.63), Cauchy's formula is obtained: 


+) = | 7 [== esee a>0. (6.543) 
0 


Other integral forms are: 


оо pat p-la 
ф(х) = -є+{ ее, «0; (654) 
в l-e 
oel ое ме. ei 
TAPA E bI TS у i 
1 = t dt 
ya) = In«— 55 2 ‚ CFA ° (6.546) 
1р р pend 
ба) - | (ae) di usd (6.547) 
0 


v(a) = Г [1+0-%—-( +0-1 c, ох > 0. (6.548) 
0 


Some particular values of the gamma function and its derivatives 
are: 


ra) = ГО) = 1; (6.549) 
Г(0:5) = №; (6.550) 
Г(—0-5) = —24n; (6.551) 
r(» +4) = anns (6.552) 
І „ту. 
г(+- ”) = OCD GNU ee) 


yd) = — С; (6.554) 


13 * 
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(6.555) 


(6.556) 


(6.557) 


(6.558) 


(6.559) 


The-graphs of I(x), He), 1{Г(х) and 1/H(x) are shown in Fig. 14 


and 15. 


я 


-2 


Aa aa AS OP ch WU. uh 


Ею. 14. The gamma functions Г(х) and Г(х+1) = П(х\. 
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IDEST 


Fic. 15. The functions 1/I(x) and 1/If(x). 


Properties uniquely defining the gamma function. A function F(x), 
continuous along with its derivative for x > 0, is a gamma function 
I(x) if it satisfies any one of the groups of conditions enumerated 
below: 


І. (а) Fat) = P 
(b) ЕФЕ(1->х) = 


sin zx! j 

(с) royr(s 4)- 22 FQ3. 
IL (a) Fx+1) = xF(x), 

(b) FopF( x ы). VE роз, 


2 22x-1 
(с) F(x) = 0 for х>0. 


Ш. (a) FQ) = 1, 
(b) F(x+1) = xF(x), 
(с) Р(х) is a logarithmically convex function for x > 0 (see 
Chapter I, § 3, sec. 17). 


ТУ. (а) F(I) = 1, 
(b) Р(х+1) = xF(x), 
(c) (e/x)*F(x) is decreasing for x > 0 (or x > M). 
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2°, Definitions, functional equations and elementary properties of the 
В (beta)-function of Euler. Euler's beta function is defined by the 
integral 


Ba, В) = | dx, a>0, В> 0. (6.560) 
° 


Integration by parts leads to the functional relationships 


ве, б) = Су ex 73% 8-0. B>1, (656) 
В (а, B) = кыт B(a-1, В), «>. (6.562) 

The B-function is symmetrical: 
В (а, В) = В(В, а). (6.563) 


The connection between the binomial coefficients and their general- 
ization. Since, when m and n are positive integers, 


_ (n— 0 0т— 0! 
B (m, n) — ЕВЕ" (6.564) 
we have 
1 _ {mtn-l\ | 
nB (m, n) -( m-1 ) 
(6.565) 
1 _ {mtn-1 ; 
mB (m, n) -( n=l ) 
whence, when «> 0, > 0, 
а+Ь—1\ _ 1 
( m )= wen m (6.566) 
«-+В—1\ _ 1 
( 2 \= mop (6.567) 


An expression in terms of the gamma function. On replacing x in 
(6.560) by у/(1 + y), we arrive at the formula 


у*-14у 


ЗЕЕ, (6.568) 
о Qr yt? 


В (а, В) = 
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whence 


„p= [^ Petty dy. 
ве, ФГе+®) = | “ууу” 


= | е—Жї+1) yo +B—1 ya-1 ax dy = 
ovo 


= | e-8x0-1 dx F e-=U(xy)9~ld(xy), 
0 0 
and finally, 
_ TG9IYB) 
Bia, f) = TG By 


Other integral forms are: 


aj 


ве =2| 


о 


2 
sin?*-1g cos?P-1gdp; 


J2 
Ba, В) = af ѕіп2ер cos?fodp, ® > - p> = 
в 


ое [971 d eo 129-1 d 
ве = oer ril atem t, 
a>0, 2-0; 
1 pod {+1 
вав = [ЫЗ a ао, 8-6 
0 d+) +B 


1 1— t) dt 
В (а, =) = ga | 5757 


Representations as a series and infinite product: 
L1 8, qs bO-)..- 6-0 : 
Bia, В) = $2 1) ахи) В > 0; 


= К+В8-+К) 
В.В) = П GFO’ 


(6.569) 


(6.570) 


(6.571) 
(6.572) 


(6.573) 


(6.574) 


(6.575) 


(6.576) 


(6.577) 
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6. Bessel functions 


The Bessel functions of the first kind J,(x) are defined as the 
coefficients of the power expansion in the variable ¢ of the generating 


2. 


1 —1 х x 
( X oaa 
e? ES = е2 te 3 


on a 
function e 


m > оо (— 1)fxrtstr-s _ оо z 
= p p "eorr sr s ES Лх)". (6.578) 
го — 1)8xnt2s 
F(X) => Rae = < х <, (6.579) 
Joins) = (= 174,09. (6.580 


The Bessel functions of an imaginary argument J,(x) are defined 
from the relationship 


1 оо 
er NEL y тут, (6.581) 
паз — оо 
оз хп+2, 
һо) = p 27+28(и + 5)151° (6.582) 
1,00) = ї-*® Лх), (6.583) 


La(x) = PJ li) = PP(—-1yJ,x) = irix) = LG). (6.584) 


The trigonometric forms of the generating functions. It follows 
from (6.578) with t = e'? that 


еіхзіш Ф = Ja(x)+2iJ (x) sing + 
+ 2J,(x) cos 2g + 2iJ (x) sin 3p +2J,(x) cos 4p - ..., (6.585) 


whence 


cos (x sin Ф) = Л(х)+2 Y. Jog(x) cos 2kg, (6.586) 
kel 


sin (x sing) = 2 5 Jona a(x) sin (2k + ПФ, (6.587) 
к=о 
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and similarly, 


gie e = х) +2 Ў Лх) cos sp, (6.588) 
8=1 


cos (x соз) = J(x)+2 У (—1)%Л(х)соь2Юр‚, (6.589) 
k=1 


sin (x cos p) = 2Y (— 1}? Jar41(%) cos (2k +1)p. (6.590) 
Е 


Bessel’s integral. On regarding (6.586), (6.587), (6.589), (6.590) as 
Fourier expansions, we get 


Г cos пф cos (x sin p) dp = (6.591) 


ae for n= 2k, п = 0, 
0 


0 for n 2 2k+1. 
0 for п= 0, n, =2k, 


(6.592) 
aJ,(x) for n= 2+1. 


| sin nọ sin (x sin p) dp = | 
0 


It follows from these formulae that 
Ja) = zl cos (np — x sin ф) dp (Bessel) (6.593) 
0 


where п is zero or a positive integer. 
Addition theorem. Since 


1 1 1 
= Тину ен Lage Ла) 
$ ие = е? =e? е? = 


- by E Dis Jy, 
we have 
A) Ул, (6.594) 
or 


J,(u+0) = у КОЛКО 


+ C= DE 7,007,460) + ЛӘЛӘ). (6.595) 
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Similarly, 


hut) = Y под, = У Lina) + 


+ 2 Insc) + +). (6.596) 


Fic. 16. 


The addition theorem in Neumann’s form. It follows from Fig. 16 
that 


В = rix —2recos y, 
R cos (p +x) = t cos æ +9 cos В = r cos x + 0 cos (л-ра) = 


= r cos æ + o cos (x — vy), 
whence 


учене = Y Рида Y (— Eoee = 
= pres Y (- ПФЛ, (6597) 
and 
Ri = Y ODÒ, (6599 
J (R) cos пр = Y (— D(9)J, Cr) cos hy, (6.599) 


п 
J,(R) sin пр = У (— ПНал(о) Л, (р) sin Ар. (6.600) 
T 
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When n = 0, 
ЈК) = JARIN) cos Др (6.601) 


When r = 0, А = 20 шу = z sin 6, 


Jz sin 6) = л(5 Je E (5 Je: 28. (6.602) 


Bessel’s differential equation, which is satisfied by the Bessel 
functions J,(x), is 


PLPA 
* DE 


Correspondingly, the J,(x) satisfy the equation 


5х0 +- ry = 0. (6.603) 


а?у 


dy i ee 
Patra 0 my = 0. (6.604) 


Recurrence relations are: 


Лаб) = I n(x) — Л(х); (6.605) 

Ina) = 449) 150: (6.606) 

TQ) = У, 095 (6.607) 
2n 

Ља) + Ini) = E F(x); (6.608) 


d d 
ах (х) = ХӘ р gO) = х". (6.609) 


The Bessel functions of the first kind J,(x), n not an integer, 


— 1} x ege 
Ja(x) = b лла (2 ) (6.610) 


satisfy the differential equation (6.603). 
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A second linearly independent solution of this equation is provided 
by the function J_,(x) (п not an integer), so that the general solution 
has the form 


y = ал + Cdn (8), 


where С, and С» аге arbitrary constants. The recurrence formulae 
(6.605)—(6.609) also hold for J, (x), where n is not an integer. 
Bessel functions of the first kind J (x), where п is an integer, 
nt> 
2 


are expressible in terms of elementary functions; in particular, 


J,@) = (2) ee (=) = 
т “resyr(z+s+1) 


x \i 2 2 x28 ^r x T | 
=(=} um Low 4d Он 2х sinx _ 2 : 
(3) E 1) Qiii E € = sins; 
(6.611) 


2 
-4 (х) = |Z cos х. (6.612) 


Expressions for J , (х), n any integer, can be obtained by successive 
ту 
2 
applications of the recurrence formulae. . 
Bessel functions of the second kind Y,(x) (Weber functions) are 
expressible in terms of Bessel functions of the first kind with the aid 
of the equations: 


Y œx) = lim Ix) cos va — J_,(x) 


уна, РЕТ for п an integer (6.613) 


J n(x) cos пл— J. (x) 
sin пл 


Y,(x) = 


for п not an integer. (6.614) 


Like J,(x), the function Y,(x) satisfies the differential equation 
(6.603), the general solution of which has the form, when n is an inte- 
ger, у = С.) + СР (х). 
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The Macdonald function is usually taken as the second solution of 
equation (6.604): 


я La)- 0) 


"= 2 sin лл 


for n пої an integer. (6.615) 


The recurrence formulae are: 


Y,40) = TY.) - Ya; (6.616) 
Ya) = У.) НЕО); (6.617) 
Fa б) = 09-4005 (6.618) 
Yaar (+ ¥n-a 6) = T Y Gy (6.619) 
Ing 1) — 100) = -2 n; (6.620) 
Kass) — Ky) = = n(x). (6.621) 


Relationships between Bessel functions of the first and second 
kinds are: 


лоу 00-09) = — 2s (6622 


LG, 209+ 00309 = 2. (6.623) 


Representations as series are: 


2 4 6 
лб) = :- (2) tm () -ew(2) 4e: (6624) 
3 
ERI 
2 
= 


7,0) = (c In 5) Л) 


ых 
м4 
a 
| 
о> 
E 
ч 


7 
+ esi (6.625) 


ajn 
Ms 
“ID 
QE 
"e 
Б] 
on 
ых 
М. 
t$ 
з 
M 
al = 
= 
е 
o. 
5 
> 
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no- = (с+в 3) AG) - 3. - 
ООО ПШ. 
NN 
һо) = 5 m (2) 3s (2) +зта (=) +...; (6.629) 
Кух) = — (с + Zo 2 oF ey бз p (6.630) 

K(x) = (c«m i) I(x) +1 z 

- Š em GY” (E =) ; 6631) 


where С is Euler’s constant (see § 1, sec. 1, 3°). 
Asymptotic formulae (for large values of x) are: 


JG) = (5 Е sin («+ =) + 04 cos (s +) 
2 В Е: л 

I(x) = (2, [r sin (s - =) 4 Qi(x) cos (4) 

2 


Yi) = | 2 | — Рү(х) соз (х- z) +Q,(x) sin (« - 


У rtm) ; (6627) 


6 
5) dps (6.628) 


; (6.632) 


| 
| ; (6.633) 
J ; (6.634). 
) 


] ; (6.635) 


mx 

where 

QAP PRSPO 
21 (8x)? 4! (8x) mt 
] o, 12.32.52 . 

Q9 = gt UG 


Р(х) = 1 


Jis E | 

тех в +: 
13 13257 

20) = тах эта oc 


Р(х) = 1+ 
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е* 


P 12 m [2.32.52 

Pix) = ——[i4-—-T———4————-4..]); (6.636) 
af 2ax 8x 2!(8xy 38x 

2 252 
LO x е (, 13. 183.5 №957 00 | (6.637) 

nx 8x  2!(8xy —3!(8xP 
о 
/ 


ast j V vede 


Ги 


А. La 29 
M ee 7 


(x) (х) 4 


09 


-04 + — + 


5 2 15 20 


— X 


Fic. 18. Bessel functions of the first kind J,(x), J5(x), J4(x), Jy—(x)- 
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у= (х) 


у= A0) 


2 х 


Ею. 20. Bessel functions of the Fig. 21. Bessel functions of the 
first kind J,(x) and 1(х). second kind K,(x) and K,(x). 


dm 12 1232 123253 ; 
Кх) =е SEO m m (6.638) 


pee ЕЯ 13 _1%35 12.32.5.7 _ 
IG Ae a х (1+ Be Dea 3HExS ^^]. 
(6.639) 
Graphs of Bessel functions are shown in Fig. 17, 18, 19, 20 and 21. 


NOMENCLATURE 


(a b) — The interval a < x <b 

[7 =, а) — The infinite interval х<а 

[Ь, + =) – The infinite interval x>6 

[a, b] — The segment а= xxb 

(a, b] — The semi-interval a< x ab 

ia, b) — The semi-interval as x«b 

(— =, а] — The infinite semi-interval х=а 

[b, + =) — The infinite semi-interval x =b 

{x,} — The set of elements x, 

x€ АХ — The element x belongs to the set X 

ХЕХ or x € X — The element x does not belong to the set X 

XcY — The set X is a subset of the set Y 

XCYor Хе Y — The set X is not a subset of the set У 

AU B or A+B — The union (sum) of sets 4 and B 

A n B, or АХВ, ог А-В or AB— The intersection (product) of sets A and В 
BNA or В— А — The complement of the set 4 with respect to the set B 


X — Thestrict upper bound of the set X 

n f(x) — The strict upper bound of the function f on the set X 
pn — The strict lower bound of the set XY 
E — The strict lower bound of the function f on the set X 
x 


max {а p EA a — The greatest of the numbers a,, 25, ..., а, 
min (a, à» ..., а,} — The least of the numbers а, a ..., а, 
п 
a} = {аһ а... а...) — The sequence with the general term a, 
аы} — A double sequence 


olt.) — a, is an infinitesimal of lower order with respect to Ё, if 8,=O(a,) 
O(&,) — а, has a rate of decrease not faster than f, 
o(x), O(x) — Orders of the function x 
lim f(x) — The limit of the function f(x) as x = x9, ХЕХ 
хэ xo EX 
E, — One-dimensional coordinate space (numerical axis) 
E, — n-dimensional coordinate space 
E, E, , — The direct sum of manifolds 
e(X, Y) — A distance 
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Ө (0, 0, ..., 0) — The origin of coordinates 

ЛХ) = fn, №, ..., X) — A linear function, or a function of a vector (point) 
| Xl] — The norm of the vector X 

Px,x,... x, — Grams determinant for vectors 

La — n-dimensional linear system 

X | E, — The vector X of E, is orthogonal to E, 

prg,X — The projection of the vector X on to E, 

prg,X — The projection of the vector X on to the vector U, 


lim ХХ) — The limit of the function f(X), when XeM tends to А 
X— A(X € M) 
Q, — The exterior domain 


Q,— The interior domain 

F = (fo fas -s.s Л») — Ап operator 

Y= F(X) — The vector form of writing an operator 

я = ЛАХ) = fy, Xa -s Xa} — The coordinate form of writing an operator 

э = My XA ах. +... ах, (Í= 1, 2, ..., п) — The coordinate form of 
writing a linear operator 

Eng — The space with norm ф(Х) 

Exe = Exp — The space E,, is conjugate to the space Eng 

Pa = рур... Pm — The mth partial product 

{Р„}- The sequence of partial products 


ее 
Ta Рита... = П P, — The remainder product 
n=m+1 
У аы — A double series 
k,l RO 
В – The radius of convergence of a power series 
r,(x) — The remainder term of the Taylor series 


F(x) ~ У A,[x* — The asymptotic expansion of the function F(x) 
k-0 


b 
fg) = | ЈОда(х) do(x) — The scalar (inner) product of the functions f(x) 
and #09 


ПЛ — The norm of a function 


b 

if-gi = d (1—8)? do(x) — The root square deviation of functions f and g 
a 

ғ. f(x) — The nth-order inverse derivative of f(x) 


а а, а, 
Бн... ++... 

P,/Q, — The nth convergent of the fraction 

K, K — The ordinary and singular values of the same continued fraction 

С — The Euler- Mascheroni constant 

С - Catalan's constant 


— А non-terminating continued fraction 
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л! — Factorial n 

п!! — Double factorial п 

Onm Or Of Kronecker delta. 

(ы) or Cz — The binomial coefficients 

Р(х), Р(х), P,(x) — Arbitrary orthogonal polynomials 

B, — Bernoulli numbers 

B,(x) — Bernoulli polynomials 

Prix) = В„(х)—В,„ 

B,(f) — Bernshtein polynomials 

(х), L(x). Ё®(х) — Laguerre polynomials 

L, (x), L(x), £,(x), 1, — Legendre polynomials 

T,{x), T(x), Т.х) — Chebyshev polynomials of the first kind 
U,(x), U GO. U,(x) — Chebyshev polynomials of the second kind 
P, у(х) — Chebyshev polynomials with respect to a system of points 
E, — Euler numbers 

E,(x) ~ Euler polynomials 

H,(x), H,(x), В„(х) — Hermite polynomials 

ЈА Bx), JO вх), FI вх), 7% (x) — Jacobi polynomials 
|x| — The absolute value of x 

sign x — The sign of x 

[x] or E(x) — The integral part of x 

{x} — The fractional part of x 

(x) — The distance to the nearest integer 

Кх) — Heaviside’s unit function 

6(x) —The delta function 

B(x, В) — Euler's beta function 

l'(x) — Euler's gamma function 

Ei(x) — The integral exponential function 

Ei(x) — The real part of Ei(x) 

li x — The integral logarithm 

Si (x) or Si x — The integral sine 

сіх or Cix — Тһе integral cosine 

erf x, ф(х), P p(x), егіс x, L(x) — The error function. 

F(k, ф) — The elliptic integral of the first kind 

E(k, p) — The elliptic integral of the second kind 

П (k, А, 9) — The elliptic integral of the third kind 

Dik, e) — [F(k, ф) — Elk, g)]/k* 

К — The complete elliptic integral of the first kind 

E — The complete elliptic integral of the second kind 

D = (K-E)ik? 

yla), Pœ) — The logarithmic derivative of the gamma function (the psi functions) 
S(x), 5*(х) — The Fresnel sine integral 

C(x), C*(x) — The Fresnel cosine integral 


NOMENCLATURE 


J, (x) — Bessel function of the first kind 

Y,(x) — Bessel function of the second kind 

І) — Bessel function of an imaginary argument 
K,(x) ~ Macdonald function 
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